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IDENTIFIERS 

ABSTRACT ^ * * ' 

The lAStitutionral Conservation Program (IC?) is a ' 
voluntary grant program designed to/^elp such non-profit institutions 
as schools, hospitals ^local governments; and public care facilittes 
save energy* and reduce anticipated erfergy-related costs. Another 
primary ICP goal is to conserve oil, thereby' reducing the. nation's 
dependence, on ialported fuels. Secondary ICP goals include folttering f 
energy conservation awareness, advancing energy coi^servation science 
by expanding its technical base of knowledge and the expertise of its 
specialists, and' improving the technical dapjicity for managing energy 
use in iristitution^X buildings. Afi evalua|.ion was conducted to ^ ' , 
determine;' (1) how well the ICP has' been administex:|lB; (2) if the ICP 
has achiisved its primary goals; and 13} whajt ^^condliry goa|l^ "have 
been attained. Thil report, on^ the ICP evaluation includes an ^ 
executive suAo&ar^, intr9ductory/background information, a description 
of the jyethodology and procedures used in the^ evaluation, and 
evaluation conol,usions ahd findings obtained by means of site visit 
observations and d^ta analyses. Appehdices contain details on ICP : 
history, additional information about the evaluation, methodology and 
the suVvey instruments us^d, and an explanation of' the assumptions 
underlying th^ analysis. .In general, ICP was found to*>be a valuable 
and well *run oprogram that has been achieving' its primary goals 
helping institutions save energy, ■moQey, 'an^oill (JN) 
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EXECUTIVE SlfWARY 



TJC INSTITUTIONAL CONSERYATIWI PROGRAM: ITS PURPOSE AND GOALS 



J ■ 

The Institutiofial Conservation f,rogram {I£P) is a voluntary grant program to 
help nonprofit institiftions— scf^bols , hospitals, local' governments , and public 
care facil ities--saVe energy.v, "For profit" institutions, unaccredited 
schools, buildings constructed after 1977, and special pur^se units of local, 
•government are not eligible- to participate in the ICP. Authorized by -the 
National Energy .Conservation* Pol icy ' Act of 1978 .(NECPA) .and Sdninistered by 
the Department of Energy through -State Energyvbff ices (SEOs) , the ICP provides' 
energy audits and grants for detailed energy analyses and for installation of 
energy-savings capital improvemeits to eligible ins.tftutions . Participation 
in the grant phase of the program required a 50% match of funds from recipient 
institutions (except in hardship cases). Four funding cycl« have been 
conducted between fiscal years 1979 ^nd' 19S2. More than $3^8 million has been 
distributed- to institutions to help finarttre conservation improvements;, these 
funds covered* 15,130 buildings through 6,270 grants. •', 

Energy costs constitute significant portions' of these institutions' operating 
budgets. Accordingly, ICP assistance provides an impetus to nonprofit- 
institutions to take steps to conserve energy. Unlike businesses or 
residential consuners, these instit-utjons pay no taxes and are thus> inel igible 
to apply for conservation tax credits. In addition, many nonprofit 
'^insfitutions have difficulty fVin'ancing capital improvements' because they lave 
limited capital bi^gets*, uncertain income, and limited borrowing capacitie%. 

The ICP established primary goals -and predicted that their achievemefnt- and- 
the concomitant publicity afforded the Program would result in the attainment 
of other, secondary goafs. The Program's primary goajs wer.e: 

f To help participating institutions- save energy 'and reduce 

anticipated energy -related costs, and - ^ . 

• . To conserve oil and thereby reduce the nation's dependence 

on imported ftJels. • ' ; . '• 

£xamples of seco'hdary go^ls arising fr^ -these were: 



0 



The fostering, of energy-conservation . awareness , and 'the 
stihulation of energy-saving activities on a national scale; 



• The . advancement of energy- corvterv^t ion science by expanding 
' its technical ba§e of knowledge ^d the expertise of its 

- special ists ; "and ► 

' * ' * 

• An improved technical capacity for managing energy use in 

instifutionaV buildings . < * 

• ^ ■ 

Has the ICP been successful in achieving its goals? The Department of Energy 
undertook an evaluaticjn of" a portion of the Prqgram to determine the extent to 
which these goals have* been real i zed . 



s 



AN EVALUATION OF Tffi ICP . 

Background <^ • 

* 1 

in October 1^1. the U.S. Department of Energy (DOS), contracted with Opportu- 
nity Systems. Inc. (OSI) and The Synectics Group. Inc. (TSG) to evaluate 
Cycles I and II of the ICP. TSG's eval.uation-^-the subject of this 
report--focused on site, visits to institutions that had completed 
energy- sSv ing capital .tnproveraents before September, 30. 1981 and to a small 
sanple of. institutions that had undertaken energy audits but ,no capital 
improvanents. On tht basis of anaf>^es of institutional rpcords. on-site 
assessments, and interviews with State and institution adivfnistr*ators, TSG 
evaluated the implementation of the program »id the imp«r«. of the ICP, and 
estimated the energy savings achieved by participating institutions in its 
sample. ' ' .. \ . i 

I 

Evaluation Metliodology ^ ^ - * ^ • ' 

lAjrking closely with DOE, OSI and TSG designed and implemented the following 
methodology for evaluating the program. Th4s , description is extremely brief: 
the report contains methodolt>g ical details. 

• • Selection of a -sample of 10 States and within- those States 
selection of a sample of institutions participating in 
Program Cycles I and II. * 

' - . • . , 

• Review of grant applications for technical assistance .aid ♦ 
energy-saVing capital improvements. ' \ 



• Selection of program^rel ated data from interviews wHh 
personnel in SE.0s and DOE Regiomal Offices, telephone 
interviews with ICP participants; and site visits to a 

. .samp"le of institutions . _ . 

• Synthesis and' analysis of the variOvUS data collected. ' ' , 

m 

9 Dey^frtent of findings and conclusions' about achievenent of 
ICP goal s.- 



TSG took responsibility for the site-visit component of -the evaluation, vrfiile 
OSI— via telephone interviews—pursued a^aluation data on institutions that 
undertook energy audits only (telephone interviews were conducted at 232 
institutions in four states: Missouri, Florida, Utalf, and Rhode Island). The 
results of OSI's investigation ^ pr^entefl in a separate docunent. ' 

, Site vtsits were conducted at 188 buildings in the 10-State sanple. The site 
visit survey design* was completed in a scientific manner to allow appropriate 
statistical analyses and projection of results to the national population' of 
Cycle I and II ECM grantees **>o had completed their grant-funded capital 

""improvement .projects before September 30, '1981 (1.012 grantees). 




The findings and condusiot^s for ECM grantees presented in this Executive 
Summary and in the attacheb\jrep€(rt are .based on 'that untverse of 1,012 
Institutions. Results from .energy-audit-qnly site visits were not designed to 

be projected nationally^ and so are presented only as descriptive findings; 
A BRIEF DESCRIPTII^N XJf PROGRAM AWIlfllSTRATION . 

The ICP is 'a(4nin*i^terw by DOE through the States, In ordej^ to^qualify for 
fund ing , the States had to prepare State plans tt>fit were approved by the 
Department. States had some latit.ude in, how they admini^teredv the Program, 
but final selection of grants was made by DOE on the basis of State 
reconmendations^ / • * ^ 

The ICP has been conducted in four phases: - * 

1. Preliminary Energy AMglits (PEaIsU which^rovided descriptive ^ 
] protiies or Duiiainq cnaractW^itie^T^ 



4*. 2.. Energy Audits (EAs) , which described the energy-use 
* '"^situation -in a Biuilding, prescribed norcost/ low-cost 
conservation measures, and assessed whether the institution 
Would benefit from a more extensive engineering analysis 
{see 3, belowj. ■' 
/ ■ ■ , ' ■ 

. 3. Tec/inical Assistance Analyses (TAs) , conducted by licensed 
engineers or. other qua! ifieo professionals jas specified in 
State Plaiis).<T~?^ccHraiien«jed further low-cost, measures, if. 
appropriate, and \identified potential energy conservation 
measures (see 4, helow) for the building. . . 

4. Enefqy Conservatjon Measures (ECMs) , which involved building 
m oa IT 1 c a 1 1 0 ns 'or inlta i lation • »t)f capitalr intensive 
improvements for the purpose of energy conservation * 

PEAs and^EAs were fund SI 'by the ICP either with direct financial support or by 
"providing a DOE-trainetJ auditor tQ tf^e institution, * TAs ' and ECMs were 
suppoifted by "DOE grants. Institutions 1iad to participjBt^ in each of these 
phtises sequentially (or complevte a non-KCP equivaVentJrin order to be eligible 
for th^ next phase." Throughout the rep6rt the term |ECM grantee" 'i«. used to 
refer to an institution that had-'Ccxupleted a cap'il;ar improvement (ECM) by fall 
6f 1981. . - ■ ' 

Findings and concliisions about Program administration are presented in tKe 
following sections. Although acfeninjstrative procedures may have. an influence 
on Program performance, thp natur^' of the site visit sample does not allow the 
correlation of energy savings with program admtnj'stration. . • . . 'J 
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HAS THE ICP ACHIEVED ITS P^MARY GOALS?' 

ThQ ICPHelped Participating Ihstiiutions Save Substantial 
Amdunts'of Energy and Reduce Their Energy Bills. ~^ , 

* • 

EA Institutions Saved Limited Amounts of Energy 

Although the site visit evaluation did *not look at EAs on a national seal?, 
selected EA sites that were visited saved 6,620 million BTUs or 0.4% of their 
-Bre-ICP consunption. Since the EA lite visit sample represents less than .04% 
of the Jtotal number of institutions that participated in the EA -phase, it is 
likely that total BTU savings by all EA participants i^ substantial. However, 
site visit results suggest that potential savings we^e somewhat less than 
projected for the following reasons. Audits oftert were viewed as f one time 
coirniitment of efiort and ongoing energy » programs were not established. in 
addition, many local governments" conducted EAs at all buildings m their 
•jurisdiction even if they were' unoccupied or used . very little energy. 
Furthermore, in some cases program* admin istrator% did not review tbe EA 
reports or realize they included specific O&M {operating and maintenance) 
recommendations. Therefore,, savings tr^y have been improved if more thought 
had been given to the sites chosen for audit and if O&M techniques had Uean 
emphasized. ^ ■*• ^' - 

ECM Grantees* Saved Energy and Money, 
and Projects Paid Back Quickly / 

** 

ECM' grantees as a. group Saved an * average- of 13.2% of, the v P^e-ICP 
consumption. This 'represented a reduction in- annual usage of an estimated. 
5 17 trillion BtUs . ** To achieve those- savings ECM grantees invested 
approximately $71 million .Jn energy conse»-v^tion imprwarients , 50% of which 

■•we?e Federal grant fundspOn the basis of a li)-year ECM life tbe cost of 
saving one million BTuJ was -$1.^7; the equivalent cost of f»e ./ederal 
contrii)ution was $0.68 fwTr million BTUsr-Not only were E^Mjprojec^s fou^^^^ 
be co5t-effecti«r, but they ^al.so pa^d back more quickly than projections 
indicated. Paybkks averaged "less than . two years, compared to nrare than fo,ur 

'years as predict® in ECM appl icat ions: \ \ 

It sht)uld be poinlied out that specific saving'^s accruing to a particular ECM in 
a,Jven building cannot be ascertained. During the period over which .^energy 
savings of ECM grantees were calculated ^ institutions took oth.er actions v*ich 
contributed to the energy reductions . achieved. Without additional appropriate 
instrunentation in gr^ptee buildings it was impossible to separate out tne 
savings from ICP-funded projects from the total savings of all conservation 
activities conducted there. , , ' \ S ^ * 

- •« * ' -. 

*ECM grantees is defined as Cycle I and II grantee^ whose ECMs^^^re completed 
as of September 30, 1981. . . 

■ • • '• ' I 

**Based on' statistical precision tests, the 90%, confidence limits range from 
9.3% to 17.1%. . •' * 



"Schools and HosR^ftals Showed Differences in Energy Performance 



An excrfiination of fenergy savirtgs of "ECW grantees,' by - institution -type Yeveals^ 
,that hospitals saved^an average ^ ..^6,360r BTU per square foot; compared to ' 
23/660 BTU per square foot*i%r schools." Yet^ school-s saved approximately 
21. 6t of their pre-ICI^. energy -consumption., v^ile hospitals saved an .estimated 
8.3%*.* 'In terms of cost,- effectiveness, 'however, schoo\|i ^nd hospitals wei«e 
fjairly Bvep , 'spending $14.45 and $12..5d respectively in.ECM costs per million 
•BTU saved." These f4ndings result from thfe' fact thafhospitals are more* energy 
Intensive than schools, and their energy usage is more , dynamic. In many 
.cases, ^hospitals" are expindiflg* or facing, in Qj:*eas,(^J^Mti en t loads. They "are 
continually adding medtcal equipment .that constfliffsTarge amounts, of energy • 
.(e.g.. X-ray and laboratory equipment) ; and they, have strict requi remits for 
climate control (e.g., operating rooms, computer centers, diagnostic 
equipment) in order to cirry out their prime mission of providing health care. 
Therefore, although hospitals may seek to reduce operating ' costs , energy 
conservation may not be considered as important an objective as, for exfflnple%- 
patien^comfort , the addition of new services, security, or convenience. ' By 
contrast, energy consunption and costs are more visible 'in schools and in. 
school budgets, , and .are more easily controlled by administrators. In 
addition, energy consijnpt4on . usually accounts f or • a- larger percentage of 
school budgets ;*%id^|Jh is g^rally easier to institute conservation measures 
"in- schools than iH^S^n hospitals. * . * . ' 

CertaWfictars Can Override Attempts at Energy Conserv<ition 

After the initial fieldwor.k period, selected^follow-up site visits to ECM 
grantees that experienced " appai'ent ^c»*"easeS\ in energy consunption since 
participating in the ICP revealed a number of Vactors that help accouij^t for 
these increases. First, compLwc fae'W ities , ( e.g., , hdspital tend 
ctfntinuously to adjt mission-orie^fed, energy-corisuning equipment- without 
mairjj;aining records; th^s constantly shifti^^g 'energy consumption makes it 
impossible to. evaluate, ECMs on- the basis of total building energy consumption. 
Secon'd, in most cases, individual metering' or Instrumentation was not 
installieiJ at these facilities sq. that ECM performance coyJd be n^easured.. 
Finally, it was seenthat a lack of an effective energy conservation program 
directed from the hi^est management level of an organization can fail to" 
provide the number and type or i;Kersonnel heeded to. achf^e energy-saving 
preventive maintenance, equipm^t fine-tuning, and energy saving hardware, 
experimentation. Th« findings of this fo3 low-up' analysis confirm the. - 
observations and- findings (described below) made fn the basic evaluation. 



*(p<.05) - Based on^isXatistic^l significance^testS', p<.Di^ indicates 
significant differ^rfce between the two percentages. , 



r. 



£CH grantees Made Dramatic Reductions In Thejr Use Of Oi 



The ICP's^ ranking criWia for ECM appi icatioBS -was designed to give Priority 
to those measures projected to sav^ the greatest anount^ ,of oil, and the. 
' Program' s,-oi1-saviiig goal appears to have- been realized.- Grantees ^edaced 
their oil usage by an .estimated 11.77 trill iorr Bm .annually or 2,25 mil 
barrels of oil tfqfiivalent. A-portion 6f this savings was due to the fact that 
a lar»ge number of' boilers were converted fnom oil to rfatural gas. ^ . ^ \_ 

These eonversions resulted in -increased natural gas consiJTiptioa 'of 8.78 
• trillion BTUs. However, even when^th'is 'increase is factored into the on usfr 
- reduction^L, net • annual BTU saviJ^s of 2.99-> trvll ion BTUs. was achieve.- 

Combined saving* Df electricity, ^liquified petrol euip. gas., coal, and purchased 

steam totalwi 2.18 trillion BTUs. . ^ 



entain Factors Maxiaized the fnergy 



"^ ' ^rWat^dn'PdterttUi tit ICH turtd! 



Thfe^ ICP" definitely resulted in energy, oi'. 
nstitution personnel -either through good fortune, dedication, or- interested 
analysis-cused ICP funds in a particularly cost-effective way to. maximize 
savings. lliose institutions that made the best use of ^iligent energy 
managers, undertook atourate and building-specific ener^^ analyses and 
installed • appropriate ECMs, persevered in the -conduct of operatiTig and 
maintenance techniques, and ^iqnito^^ energy usage showetl overall greater 
savings. Find-ings relating to thefee factors -are discussed below. 



4 - 



Cownitment of Personnel Maximizes Sav^s ^ \ 

While/ investments in erier^y-conserving .hardware . save energy , th.e iCP 
experience suggests that yie coimiitment of personnel , particularly iXstitutiqn 
managers, is critic?!' to limximiiing energy savings. Throughout the ^uation 
it was seeri that energy performance ves related to the leve? of commitment of 
the-- desiarrated enemy manMier. During the. f iel(k sdf-vey, managers were rated- 
excel l^t/^g^,^^^^^ in term? of ttyjir^lverdll involvement/in energy 

management. Institutions rated excellent in this areTjex peri enced aver^^^^ 
savinas of 19.8t, compared to 9% for other* institutions p<.05) . This is a 
stJo^? i^dicati^ tW^ctein'Utra^^^^^ who exercise leadership and are involved 
directU in conservation consfitute-^ an 'important element of successful energy 
program. % Furthermore, the .^dsition of the energy ^manager within «he 
institution's organizational •structurcf^can have an p^t on energy savi/igs. 
When managers had daily contact with buildings' operating . personnel , higher 
pavings generally were achieved.' , j.; 



Thoroucrti Analysis Of Eifergy Cbhseryati on Needs 
^6 Approprifte Selectibn Of Capita,! In^rovfiments 
Are Critical To Successful Energy Conservation Programs^ 

During site visits it was determined that the' quality and use, of. energy audits 
Jnd tX analyses varied among institufi<?ns . Primar^ily, anajysgs ^of ten were i^ot 
buflding specific. One common' pattern observed, ^is 'that aulitors .tended to 
recomie^ the same 04Ms and EC|<s- for all butldings. The ovirall resjilt wrf^ 
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that xfiereas'recxjmmenttations were sucicessful In ^ome of tlje buildings, the 
same reccSnn^ndations resulted in lower aavvngs at ctther bui,ldings.' • - 

Secondly, ,EAs q|ten did not serve as edicational tools for' Institutions . Many 
. respondents w^re unfaml'liar with specific EA recownendations and potential ' 

energy savings were not realized. Furthermore, on- its own. the BA did not 
' guarantee the implementation of O&Fte, as evidenced by the findir^ that 41% of • 

ECM grantees did not maintain their O&Ms. Where long-term O&M" efforts exist 
^ it t^nds to be due to thie presence of an el'fective energy rtfanager. 

• Similarly, TA reports often did -hot provide the technical det^ls for a 
ccmprehensive energy conservation program. For example^ onl^^^421 Of the TAs 

. . reviewed recommended a full range of possible ECMs,* and only 39% of them 
, recofimended O&M activities beyond those in the EA. This findinig was further 
supported by the observation t^iat TA'analysts often did not coordlnate.t^r . 
efforts wTth institution staff. .For such cases, energy savings were redi||ed 
by as much as 8 percentage po'ints compared to other grantees. 

ECM grantees made four types. of conservation improvements: (1) modifications 
to the builJlna envelope (Kg., structural modifications to windows, doors, 
roofs and waifs); (2) inrj^rovenfents to mechanical systems (e.g., bpilers, 
-pumps, HVAC systems); (3) changes (e.g., conversion from incandescent to 
fluoresc^t lighting) or reductions In lighting; and (4) insfallation of 
special systems {e.g., solar or alternattve energy systans). Improvements to 
mechanical' systems tended to be the most common types of ECMs undertaken. 

Several factors affected 'institutions' decisions about" which ECMs>*.tqb Install . 
In addition to cost effectiveness, ECM selection was influenced by the 
availability of matching funds, the degree to wh1(;h the building's normal 
operating schedule would be disrupted by the ECM irrstal latlon process, the 
degree to vi^lch the ECM might be affected by the Institution's ongoing repair 

V and maintenance -schedule, and the degree to which the Institution planned to 
Install the ECM with Its own funds. , 

t 

r • 

f Effective and Continued Operations and Maintenance . . 

Programs Increased Energy Savings , . /' ' ' 4 

' Field survey teams observed that several ECM grantees were not maintaining- the ' 
OJM measures recoBin^nded in tfieir energy audits. This grpup saved an average 
of >.2? £ompar*ed to an average of 15.5% savings experi^ced by grantees 
observed' to be keeping up with the 0AM measures recommended In their audits 
' (p<.05). Institutions observed to be maintaining O&M measures beyond those 
resulting from the energy audit experienced '15. 9% average savings, compared' to 
an average savings of 7.7% for those who' did not pursue .O&Ms- beyond the energy 

. audit {p<.05). This finding Is further supported by tt»e energy savings awd 
cost effectiveness of schools and hospitals when examined ifidependently. 



ectlve Npnitoring and Metering Increased Energy Savings 



Although the EA, TA, and ECMs were intended collect ivety to facilitate reduc- 
tions In energy consumption, very few Institutions were found to have the 
administrative or mechanical capacity for systematically monitpVing and 

' y ' ■ ■ ■ ■ 15 ■■ . . ■ . ^ 



controning the ipaljor factors that may xause'high coosunption. In the cases 
where monthly. seaSonal , or— more, often— ann4ia\ monitering of. consiOTption is 
performed, there d(^s not seem to De an effective application of the resulting 
knowledge for the purpose of reducing enprgy consumption. Whereas 47 percent 
of the ECM sites reported some type of monitoring activities, only 18 percent 
actually metered ^ergy performance. In other words, it is doubtful that 
timely investigation and corredtion of inefficient hardware operation resjjits 
from the* monitoring activities. ' A ' ' . 

The ECM grantees that ma-intained recorcls qV Energy use and used thdse records . 
to measure energy performance ex p*i en ced hlg hen levels of energy sav.ijras than^ 
those that did not monitor. Data anal ysiV^ows that fl^^^ees ' conductino 
monitoring saved an average, of U.9% as opposed to 7.5% for those that did not 
monitor {p<.05).^ * ' ' ' 

I * » *. ' , , < 

■ ■» . ' 

• WHAT SECONDARY 60AIS WEIffi ATTAINED . . 
The ICP Stimulated Energy-Saving Activities, j 

SieVenty-tw) percent of the ECM grantees repprte4 that* they would not have 
Sdertaken their EC» projecfs within 5 years . without ICP funding, ^his 
information indicates that the Wggrm played a dominant role in the pavings 
that were achieved. .1 • 

Beyond the actual energy savings -achieyed-. it appears that the. ICP Jjas 
Increased the awareness ami interest of adninistrators in energy conservation. 
For example. 53% of ECM grantees reported that they. had no energy conservation 
program' prior td* ICP. How/^er, since participating in thevrcp. 45% of the 
'grantees had implemented nrfh-ICP funded projects and 65% had specific -energy 
conservation 'projects planned for the fqture. Fifty-four percent of the EQM 
grantees showed evidence of en«rgy conservation awareness in the form of 
reminder signs and posters throughout their buildir^s. »" ; 

Interest And Expertise In Energy ' • ; . 

Conservation Has Grown Considerably »«»»«s^ ' 

. SEO" personnel repoTifed that the benefits of the. -fCP (extended beyond 'actual 
^ fuel savings for participating institutions and included- increased training 
and support' of -energy conservation specialists (engineers, auditors, and 
monitorsT..and generation of basic^dat? bases<;bn builcfing prof iles 'and ^nergy_ 
consumption.. on a St ate-by-Stafe basis. if 

In addition, several slates have Initiated energy conservation progr||s as a 
result of the ICP, Although designed around the ICP. these State programs may 
include alternative funding mechanisms such as ^W^i'tJ^'^t Jwns, r^^ 
loans, and shared savings, as well as direct grants to institutions. 
•staff attribute to ICP an increased interest in the potential for energy 
savings in non-eligible facilities." ■ . . . , 
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.WHAT VAS LEARNED ABOUT (|^6RAM AlMlKISTRATION? . ^ ^ ' 

■If>terviews with personffel 'tn the SEOs and with'i.staff at parti^pating 
i/>stitutions provided that extra di^nension-^of Jcnowledge about implementation 
so* valuable to any Federall^r administered program. The States varied 
considerably in their adninisfrat.ion qf :the ICP— nothbly in 'the areas of 
methods for pr ocuring^Tnat&hing funds*, col.lecti/ig -basel ine data on eMgible 
participants, Reviewing applications, developing 'energy audits, and conducting 
auditor and analyst -t^aining'-and these vaciations explicated the evaluation 
effgrf. A synthesis of • the information gathered about Prdgram attninistration 
.can be/sunwiarized in the foUowiog general findings: . ' ^ 

The ICP Was Hell Received and Attracted 

Widespread Partfcipa^on by Institutions. • ■ • , 

Throughout the administrative process interviewsT ^0 officials state9 time 
and again that the ICP was one of the best run and mpst useful' programs of its 
type^^ During Cycles I and II more than §5,000 EAs were conducted rtationwide. 
In d>e 10 sample states EAs of 27,0001 buildings«or ^% of eligible institution 
bui/dings were completed. About 5#3d0 TA grants covering 14,0M) buildings and 
• 2,853 ECM grants covering. n^rly 6,800 buildings .were awarded national \y'; ^ In 
the 10-State **afflple 779 ECM grants cover^ 1»642 buildings were made. 
However, there were more than twice as mar^ ECM applications as could be 
funded. Reasrons , cited by SEO personrv6l for high participationVates included 
mandatory participation by State Departments of ' educ^rtrr^/^ • and widespread 
publicity and Program monitoring. 

■' ^ ' r ' 

Barriers to Igylanentation Were Regaled. 

SEO staff also cited several factors that they perceived as barriers to 
participation by in»titutiohs . The four major o;ies were: ,f 

a excessive paperwork; 

• fear of Federal or State intrusion into operations; 

• lack of funds to meet this Program's S0% match requirement, 
and 

• l^ck of financial incentives local government and public 
care facilities. 

^ V ^ . , /. ' ^ ^ 

These factors were confirmed as barriers in conversations with institution 
personnels- * ^ - * 

SEO personnel identified several concerns with Program implementation; 'such as 
th^ inherent restrict^Weness of all Federal pr^ogram regulations,, adninistra- 
tive inconsistencies in .review procedures, recurrin^i^ changes in Program 
funding levels and regulations, and the often limited size of their own 
staffs. These concerns were viewed largely as administrative deta41^, and SEO. 
personnel maintained that they had no* substantial impact upon Progran results. 

« 
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In October '1961/ the U.S. Oepartmefit of Energy (DOE) ^oijtrac ted with. 
Vr%^m %"iy^,iL" Jut\i: matching- funds to help four types af 

oIrt?ciDatSg™nstit«tlS^?s' achieved, using data collected frf Cycles I and II 
^artlclSa^S? l,1s "report pr,««ts. . the . f 1 ^ttgs ..a-fl , I" 

At> a1 iiaf -inn ■ • 



evaluation. 



THriNSTITUTK^L QONSERVATION PROGRAM 

The Ifistltutional . Conservation Program (ICP) Is ^ ' f ^?r^ 

schoi sf bu1lSl^5s constructed after 1977 '?r.^^Vp^'TthSr ized by thl 

rtro;srUytnsMii.n ?'o,??;^m%^8"',WpS -^sSn^Mt, 

ME througS^»te Energy- Offices fsEOs) JCP proyldes aie^^^^^^ and 

substantially less. ■ ' , ' ' 

Non-profit instltutlohs use Slgn1f1c'i,t anount* of 
costs represent large proportions of their bMdoets.-^^ 
irPw»5 intended to provide incentives to nonprofit ^l*^^^tut^op»'to we tiieps 
f c"onse"rif energyrunliK? "usin.sses o, resident al ^ops»ers the . 

JSnt'AaVl»%S'pr":.i"""-In^^ 

"f fc"uftrf1na"ci£j1!i?lia1 Vov^ftsVc.lse .they J-ve^limited capital 
budgets, incertain Incone ar^ 11m1ted»borrov.1ng capacities. 
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While the primary goals of the ICg are to sah energy and reduce dependence on 
imported fuels, additional benefits are expected, natoely: reduced^ energy costs 
for participating irtstitutions, an improved technical capacity for managing 
energy ^e in institutional buildings, and an enhanced level of expertise 
regardtng energy cojjservation among professionals, in nelatpd inrf&stri^s. 

The ICP is adninistered DOE through, the 50 States, the Oistr'ict of 
Colunbia, Puerto Rico, Guam, the Virgin Islands, aid Anerican Samoa. In order 
to qualify for funding. States had to prepare State plans "which were'approved 
by DOE, States had latitude, in how they administered ICP, but final selection 
for .grants was made by DOE- based on ^ate. recoinaendatlons. Nevada was the 
only State that elected not to participate in the first two cycles of tfie 
Program. ^ 

As required by. Program regulations, the ICP has been conducted in four phases: 
(I) preliminary energy audits (PEAs) , (2) energy audits (EAs) , (3) technical 
assistance analyses (TAs), and (4) energy consjervation mMsures '(£1^^^ 
Funding was made available, Jor activities In all four phases. Instituti<His 
had to participate in each df the phases sequentrf^lly in order to be eligible 
to participate in succeeding phases. 

• Phase 1: PEAs —tIH preliminary energy audit phlSe involved ^ 
iHTonnat ion-gathering that determined the size, functibnal 

use, and energy consumption char aifteri sties of eligible ^ 
buildings. Eligible Institutions completed general energy 
profile- survey forms. — 

• Pbase 2: EAs- ^Enerov audits involved more detailed 
information gathering on energy consiroption characteristics. 
They also identified low-cost/ no* cost energy-conserv ing 
opepating ana mrfntenance procedures (^Ms) and assessed 
whether the institutions would benefit from technical 
assistance grants. PEAs and EA^ were funded by the program 
either with direct financial support - or by i»*ovidina a 
SEC- trained auditor to the institution. 

• P>^ase 3: , TAs — The detailed technical assiil:anc« (TA) 
analysis^ which examines conservation opportunities fn 
^tail, is performed by a licensed engineer >)r other - 

^ qualified professional. Potential energy conservation 

measures (see below) and their associated costs are , ' ' 
"^identified and the most suitable are recomnended. The TA 
^Iso seeks out additional O&Ns not identified in the EA 
phase. 
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• Phase 4:<ECMs- >In the ^"^h Phjse . energy fo^^lJiJ^^^J" 
• Measures are In stalled 1n Institutiorval buildiiys. ECMs are 
defined by the ICP as any physical modification 6r 
installatiii oi^ equipment that reduces energy use |nd that 
involves a payback periftd of more than ofc Z®*'"- "'^Slr 
a?e syst^ mod if icat lons^ and equignent rBpU^men^. 

' insulation.. solar systems, automatic dShtrols, etc. W- 
. fuhSed EO^on a cimpetitive b^sis. a^^^^^ 

factors, the most iroportant^ being the period of time 
required for tlfe measure to pay for itself thjb ugh energy * 
savings tthe "'payback period")*, as -determined by^the TA 
analysis. "* * • ' 

'I 

PROGRAM PARTICIPATION / 4 ' 

T«hia 1 1 siflimarizes the ICP activity for its first cycles (fiscal year 
Im'sl)} r?J>« tte ni^^ Of institutions covered, nunb«- of grants 
awardS' and ^SSts of fuiKl.ing fbr each prog ran jj^ase As Tab 16 1.1 
PFAs Bnd EAs were funded only during the first tvo cycles. Most 
'fu^ds tove ^en !s1d^^r grants for ECrfi. ftore than $378 i^illipn has been 
distributed to institutions'- to help finance conservation imprwements. 

« ' » * 

OTHER BAGKSROlffiD INFmWATION 

annpnd^>tv.A contains more details on the Program's history, jpclut^ing 

S^tJ> pro A^^^^^ criteria arxl the ^^^^"Vifi.f ^^^ME^^'stJtl 
JfifluiatSY history of the ffogram; the Program responsibilities of M?* State 
e^l!gf^7fici.af^ Institute variations within the program; and. the 
events that le^^tKthe ICP evaluation. -f 

ICP EVALUATIOM OBJECTIVSS ^ 

The ICP evaluation's four pri«na»*y *J^tives *«re to: ' ^. 

. ' • Provide an assessment of Progran operations and an analysis 
of Program results . 

Collect inforrakion to prepare a report O" ICP that 
" • SSantIf ies and correlates field d^ata and that ^^^t^res case 
histories, the extent of administrative success, and other 
^ such anecdotal infohnat ion, as appropriate. ^. 



*7he average slmpl? payback in Cy\le Tand II ECMs was projected to 
be ^ut 4.5 years. * , • 



TABLE 1.1 I CP GfiANT CYOE DATA 



Cycu I 



Cycle II 



Cycle Iir ^ / Cycle- IV 



Number of institutions co^hEd.- P£A 
hum&er 0^. fhstitutiws coverep * eaj 
ScMoots \ 

HOSPI-TALS 

LKAL GOVERNWirr 

Public Cade 
TOTAL 

* 

Actual Awards - ' 

Schools/Hospitals * * 
Local Government/IH^Iic Care 

TOTAL COflBINED (PEA/EA) Afa 



117 



000 



'5,880 
* 2.428 



65,150 



— 1 

> 18,000,000 
8,<lOD,000 
$ 2^,400,000 



' i 4,700,000 
6,400,000 

»11,100,000 



\ 



\ 



AWARDS 
nAO£ 



Ifl 

SCWOtS/HOSPITALS 

fttmflEAfOF GfUNTS iteARDEO 

Number of Buiuinss Covered 

L^L GOVERNrtEHT/PUBtJC CARE 

Number * OF. fiRAHTs Aharoeb 

HumER OF BUIU>IR0$^VERE0 
GMHT ArtOUffT <$) 

I 

SCWOLS/HOSPITA^ 

Local GovERNf^NT/PusLic Care 



2,755 
6,635 

404 
1,196 

* 20,947,372 
3,061,973 - 

< 24,009,345 



1,677 


^ 1,125 


4,985 


3,438 


473 


254 


1,620 


1,299 



$13,390 695 
3,029,741 

$16,720,436 



$11,03S,(»3 
1,968^029 

' tl3,053,092 



408. 
1,307. 

.n/^ 
m 

$3,330,000 
M/A 

$3,300,000 



Eca 



Si^OOLS/HOSPITALS 

Number of Grants Amarded 
Number of Buildings Covered 



^ant AnOUNT C$) 



, 1,306 

' 2,5^ 

$90,316,516 



1>547 
^ 3,419 

$90,877*^9 



^2,288 
6,167 

$144,525,284 



1*129 
3,004 

$43,XX),900 





Sources: u. S. Depart>Int op Enerav, I nstitu tional Conservation ,Pr(^ra«s Division. TitCe x sunset pRQfiyiQt<a . 

"l*RfPAR€0 By CORfORATtW/ tD^^* tlMXSR ffilC NO* EFOXMtRM) ^ » ' t ' ' 



"GMllt ASilSTMCI rcM CCtt M> MLT «VAILASU TO UWOU «M) HOWITAL) llullm TW n«»T TW mwT CTCU8. ' 



• Provllje a basis for developing a guidd)ook for future ICP 
participants, jss weTI as designers aod users of / similar 
energy-'cdnservatlon programs. v . 

• * ' ■ • ' ■ * • - •• 

• Provide DOE headquarters staff with feedbacks on Rrqgram ^ 

' operations 'W results. ' , ' . b 

me evaluation tasks that support these jrim^y objectives and that vicre used 
to evaluate various program activities are presented in Table 1:Z. 



STRUCnWE OF THE REPORT . ^ - 

The chapters that follow describe the eval uation -and ittf resuUs. 

t Chapter 2 "presets a brtef .desicription of the methodology 
.• * and procedures used In the evaluation. 

^ ' . ■ * 

• Chapter 3 contains evaluation conclusions and findings 
cAtained by means of site - visit observiations . and data 
anal^es. , > . 

* • The ilppendices contaiji detail s^ on ftrbgremi history, and 
additionial information about the ^aluatlw methodology, the 
survey instrum.ents lused ^1n the evaluatiop, assumptions 
- urrierlying the analysts, and- a glossary of terms used In the 
study. ' % 
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TABIE 'I CP PROGRAM AND £VALUATI0N ACTIVITIES 



' • i 

1. Assist S£Os 1(1 developing wi 
Impl^entlng State pi ads « 

. ' . ► ^- ' 

2. Conduct EAs at nonprofit Instltn^ 
tlons to d^tejpiHne opdratlf^ wi 
maintenance ^ar^es to reduce 

lergy consumption, 



main^ 
ehen 

/ ■ 



ICP Evalitf^tlon Activities 



1: Interviewing SEO ami S^loQal 
officials. 



2%. Sampling^ collecting^ aod 
"conputerl Xing'* of detailed 
Infocm^tlcm free form InJO 
selected States. 



Zb^ComliKtlng telej^fone Interviews 
witn saa^led EA^Institutlons 
participating' In Prt^rm Cjrcles 
! wid II to detenaine changes in 
aiergy consuppt1<Ki resulting 
frm EA activities. ^ 



Meet Evaluation Objectives * 

I. IV' * 

•it • 



3. Provide TA^'grants for detaiied 
engineering analyt^fs^of : 

* Appllcabilltjr annd completeness 
of O&H measures recomended In 
EA phase. , 

- Potential fcr energy savings * 
through use of i^engy conservation 
measures. r 



3a, ftwrfonping^brief review of TA ^ I, HI, iV 

refK)rts conducted at EA institu* 

to coBHMire ttie' (KMs^ ^ ' 

reccB99«K]ed in TA and £A-re|K>rts* * 

3b. p^^fgming (teta11etl'«mineeriim I^ HI 

analj^is of a s^l^ of TA 
re^rts fron institutii^ r^eivlng 
ECH grants* 

3c. Conducting site visits of ECM grant . ' I^ ill 
recipients to coopane actual condi- V/ 
tions to those roconded in the TA 
reports. ' ; - 



4. %i¥Dv ide ECM grants to ii^leaiait 
conservation iqeasures* thekt will 
rediK:^ energy \pnsumpt ion at 
participating Institutions. 



4a. fteviewing graftt ^licatiMs 
for technical gyallty and ciwtforaef^e 
to fw^ogrM (^u1 at i»is. 



latifl 
vi<i 



4b. "-C^ucting site visits H)f caaplet^ 
ECM grants to detemiw perfonnance 
of i^suf^s ftuHled • 



in. IV 



I, 11, HI. IV 



5. Disseminate and ^blicisei'the 
, energy conservation potential 
t at nonprofit^ Institutions 
nationwide; ^ 



A 



Sa. Intervlewifm Slatfi. ftegioMl« and 
Headguafters officials to determliy 
technigtms usad to i^licize the ICP. 

• ' ' ^. 

Sb. Oevelopif^ (tota^1i»i guiddtlMk on the 
suc^seAand prc^leM related to 
diffet^t tyrat^of OtW measures . 9Cs, h 
TA fevii^ pi^Kedures, and related 
^eCtoinlsbrative (^)froa#es takmi by 
SiQ$ and part icipatinf institutimift. 



in 



*Eyal4ttti^ Objettives Xay - . / ♦ ^ 

t* Assess progran operatiims and res^1ts. • 

U. Sather quantitative data for 4(1^1 ^si) of onergy^savfngts. I 

III* COBpile infor«atij»! ftor •»i»^to" gii^Mmk^ * * * /.^ / 

ivr Prov«e ore he4d^rt#fs wlUii JMdtMck on Pr^grA i^nratiMa. 



^ / ' 2. THE' ICP EVALUATIOH. 

- OVHIVIEM OF Tl€ EVALUATIOM . . 



'ERIC 



■S. 



" The ICR evaluation has five mdjor nwthodologlcaV^awponents: 

* 1. Sample Se^lec tlon— Thy, survey wethodology for sas^ltng Statei 
. WRTOTTOSnSFrsltes within those. States m$ d6s1gned 1n*a 
sft+6Trt4*ic manner So that results could be' extrapolated, to 
the ICP nationwide for the j^ase, and Cycle I and II ECU 
grantees with coB<|1eted projects as of Septewber 30, 1981. 
•However* llwitations of the telephone survey effortf- 
ul timately restricted EA findings.* 
■ ' ' • ■ ' ■ * . . ■• ♦ 

2. ExaalnatlQO of Adwln^lstratlve Procedures? j -State energy 
. offices perswmei in^jieiected States wefef interviewed to 

^ • . determine similarities and differences In Program 
a«te1n1str*at1(»»., 



*i4 '3. Evaltiatlon and Oata Collection at SMPle S1teS" rData were r-^ 
collected afld institutional personnel interviewed at sites ^ 
that had undergone experience Vith the EA ^)has^ of the ICI^ 

■ , ' and with the EA plus- ECH phaseK Information was gathered 
jflfP^ both by telephone and through on-site visits. 

4. > Analysis of Data— Information on fuel use before and after 

t|ie' ICP was analyzed in cqnj unction vfith Wwerwions made' 
/in the' field. A i&lde rarwe of findiogs were souqht on 
administrative procedires, institutional implementation of 
\ - the program, and ertfrgy consunption remits. 

5. Report yritinq — Th% various kinds of quantitative and 
.qualitative data were used as the basis for preparing the 

^ report and will be uised in preparing the ICP guidebook. 



*See KnstUutfonal Conservation ProqfaW! Analysis of ^the Intact of 
• the Energy AiidH In Selected InstftSHons . prepaf «f ^y -^p6fturrTty 
, int. ' 



SyitMi,nnt. — T i 
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The rwijiinder 'of this c^pte^ presen|s a brief description of* the foTlowIng 

topics;* > .* ' - » 

• . ' . «• , " • . ' . • 

• The saii^llnd isethodolc^y ^ 

' ." ^ ■ ' ' ' " • 

* .<e* The procedures undert^kefL to collect Information ai^ data on 
^ 4mplenentatlQn.of^the fr4^am at various study sites 

% , The prob1«BS encountered In the cot^se of the evaluation , " 
Hie nature of the evaluation's detar^a^e" > 
Details of the methodology are presented tn Appendix Bl 

The evafuatlon was broadly divided into ' two components: telephone survey 
work and site visit Investigations. OSI had responsibility for tne telephone 

survey, and 1156 was responilble foV* the site visit evalnjatlon. The primary 
focus of this chapter, and of the succeeding findings and conclusions. Is on 
the slte-^vlslt evaluation, conducted by TS6, The te1ef^(»ie survey methodology 
and results are discussed In a separate' vol Uae prepared by OSI: Instltutjonal 
C onservation Program;/ Analysis of the Impact of the €nergy Audit ln Selectw 

iBftnutionr : — wwevw, wgrence i s Iwe'^tg tn§ mepnpre survey aet i vn T es 

when It will to help the reader understand the flow of the evaluation. ' * 
SAMPLE ^LECTICM 



A san^le of ;Rore than' 2^000 Institutions In 10 States and 8 Federal Regions 
was- selected ustng th^ statistical methOdolog^jL described briefly below (see 
App&ndiji B for details).! This sas^llng pim^s submitted to bOE/OMB for 
approval. Approval of tne current soipllng mn andCsurvey l-nstr^nents was 
received In April 1982. ♦ . ^ \. • • 



In determining the jinsti tut Ions froh i4\^ch data would be collected for the ICP 
evaluat'lon, a 'two- stage sampltrig plan was devel^t^ to maximize both cost 
efficiency and statistical validity. It 'was designed to f enable reliable 
■generalizations to mi^e about the Cycled and If grant recipients. and ECM 
projects completed by S^pteiMier 30, 1^1, nationwide; In «ld1t1(m, the sample 
structure allows acc^tably precise estimates of JCP's impacts upon schools 
and hospitals that (rogressedtthrot^h the ECM phase.- 

sapling w..>fo™W. In .1r,t. States were' sel^fd/ second, 

sites Within States were selected. Both' are disciased In. the sections that 

fallow/ * '* 

: ■ , 

'State Selection • * 

Because. ICP grantj^ are administered on the State l^el. States were chosen as 
the Prtaary jSai^lIng Units (PSOs) for da^ coUectlon. Aftet*: con^ltatljon 
with Doet tt.)fB5 determined that IQ States wouM frovlde the maximum number of 
PSUs ccmpatlble with time aM budget constraints; ' 



The seledion of SUtes .was plaptlally a function of the pofJulati^on'wIthin 
ead! State'. - This detenailnation was made in otd&r to maximize coverage of- 
institution types and ECM iWtalltftions within the 10-Sta^j^w1e. Thus five 
of the 54 States and Territories {Mew York," minolsV Myftsot^, Oklahoma, and 
Virginia) were chosen with certainty^ .as they c4N»tained"t!ie largest nunber of, 
eacS of the five target populations (the four institutional types/and 
completed ECM sitfes) . .'The remaining 49 PSUs were grouped Into fivtf strata of 
approxImateTy equal size and cTim^lc conditions, »One State was chosen from 
each stratum with a probability of selection proportionate, to the size^of the 
population of ICP Twrticip^in^s. .These states Sre Utah, .Rhode Island, Florida, 
Missouri , and Mfw. Mexico. . ' . ' 



( 



site Selection 



EA Sasiple ^ \ . 

For details of the EA sample design and selection refer to Institi 
Conservation Program; AnaCysis.of the Impact of the Energy Au^it in 5i 
InstHution$, prepared by- Opportunity Systems, Inc. ' 



ECM Sanple | y* * . 

The sampling uivJt fof^this phase was defl^ied as an ECM graptee with a Cycle I 
or' II Im 1nsta?tl«t1on completed by- September 30. 19^1. Telephone inquiries 
of SEOf provided an estimate ^ of approximately 1,000 such grantees nationwide, 
400 oif i«h1ch/ell within the 10 selected/States. In view of the relatively 
iittll^/slze of this ECM universe (DOE had originally pro^sed* a sampl? of 1,000 
ECM grantees),, it was decided to modify the -sampling scheme in -conectino 
baseline ECM informWion; background dl^a would be collected from the 4ft0 
completed ECM Installations within the 10-State sample. The site vfsit sample. 
4ncluded 150 ECM grantees and 50 EA*only sites. * .*/ 

• . . . )' ' 

Modification of the Site Visit S«^le * ' 

The original sajnple of 200 site visits ms modified if respondent refusals to 
. equal a 94% response rate of 188 buildings?. The total sanple of W site 
visit buildings Included 44 EA-only sites, and 144 ECM sites. Due. to sanjple 
design and States' . def1n.1t1ons of -buildings,' multiple buildli^ of a complex 
often were included In the sea^le. In «any caseis, on-sitA investigation 
detemlned that central metering at the complex precluded the ident1f1cat;^)n 
of energy data' for individual buildings. 'Therefore, the 1^ site visit 
buildirttl^ ultimately ac'cpunted for 168 evaluation ^ites: 43 EAsl»*^nd 125 EtMs. 

Several problems resulted -In a further reduction of the .'sample. Although 
every effort was made to collect complete and approj^r'late energy data from 
institutions during the s1te,v1s1t#, it was not always possible to do. so. In 
addition, at some sites Itfwas discovered that ECM Installations had bteen 
complete for such a Short t/lme that adequate comparison /of base and latest 
year consunptibn data was jj0t possible.- In a few lariger school districts and 
local government btftWIrfgs, respondents '-dld^ not have ^access to energy 
consunption records that generally were kept by central accounting offices. 



Finally, data prob-lems arising during analysis precluded the usi^of some sites 
from the data bAse. Therefore, the final data base include 13$ evaluation 
sites (80% of the total' sampl e) : 24 EAs and 112 ECM$. • 

Because the EA data base includes only 24Mnstitutions,; no attempt is made to 
project the findings to a national population. However, appropriate weighting 
has been applied to ECM institutions; and. results may be projected to 
represient all Cycle ^ and U ECH institutions with completed pj^ojects as of 
Septemt>er 30, 1981, natiwiwide. 



PROCEDURES FOR GATXERING DATA ■ ^ ■ ' 

Administrative Piftxess Interview 

An evaluation team visited the State- Energy Office (SEC) in each of the 10 
States to interview personnel a^ut issues related to acini nistrat ion of the 
ICP. • Background information, administrative histories, and opinions on 
Program performance were -solicited, with an emphasis en distinguishing 
State- by-State variations. s ' 

gathering Information on Study Sites ^ ^ 

Wh41e the administfative process interviews were "^talcing place, other team 
members were microfilming data in the same 10 States. Using the sampling 
plan, they recorded all docunents {PEA, EA, and TA reports and ECM grant 
applications) filed by ^he institutions in the sample. Data elements from the 
microfilmed dq,ciinents were analyzed, cpded, and Watered into a computer data 
base.*- In the process, missing, incomplete,, and/or obviously inaccurate 
information was flagged. Tliose pieces- of data considered essential to the 
evaluation, were pursued in later contacts with personnel from the 
institutions. ' . «^ 

^ X 

Telephone Interviews 

A samjsle of participants in the EA phase of the ICP was choMni^ telephone 
<ynterviews. An interview appoirttment was set dp in adv^n^th the most 
appropriate staff members at each institution. Using ^pFOMB-approved 
questionnaire, telephone interviewei^ at OSI sought' infomfattpn on the results 
of the Prog>am (e.g., which 04Ms were implemented, effects on energy 
consumption, aAninistrative procedures,' other conservation measures 
undertaken), as well as other physical changes that may have affected ertergy 
, usage. At the same time, interviewers attempted to clarify data that were 
. missing or otherwise unsatisfactory in the original EA report. 

Site Visits 

\ 

Site visits were scheduled for maximum efficiency and proximTty among study 
sites.. Thus, although the EA and ECM site visits are discussed separately 
below, the same stlidy teams visited both, as geographically convenient. 




TA l^iew 



Before all site visits, TSG's engineerinqf staff analyzed the entire package of 
docunents relating to each institution to be visited.^ The TA report underwent 
special scrufl^r prior to ECM sUe'Visits (see below). The analysis prepared 
the survey team for what they should expect to see in the field; it a1.so 
provided- insight into the approach taken to the TA. as v«ll*as the- range of 
ECMs originally suggested. 

» 

EA Site Visits 

^ . ■ . V 

In order to l^sess the appropriateness and effectiveness of reported OliMs^ a 
sample of, 44 EA institutions selected for the evaluatjon was visited by survey 
teams,, to per^oirn an on-site inspection. Ifm-4^Trfe4«».^gersonne1 -wejcLe- 
aitninistered the siame questionnaire that was used in the te1epn3heJ4nterviews. 

^ (The "site visit" institutions were not part. of the "telephoned" sample.) , As 
in the phone interviews , miss ttig -or otherwise unsatisfactory, data were 
pursued. Because of the more personal nature of the site visits,*^ a 
significant amount of anecdotal information was proffered, data that are of 
great utility in developing case studies, in -evaluating the results of the 
ICP, in prwiding qualitative information to support findings, and in 
producing the guidebook. s" 



ECM Site Visits 

In order to assess the appropriateness, effectiveness, and Alntenance of 
reported OflMs and installed EC>^, lISO of the pool of completed tCM ^ites were 
selected for site visits. The detailed design of the site visit sample was 
finalized after- collection and preliminary analysis of base-line data. ECM 
institutions were stratified according ta sizelscoss floor area) , . dollar cost 
of project, and type of ECM. Cases were sel^Sed raiWomly within strata for 
each subpopulation to j^iMluce a distribution across States and^ institution 
types whidh is proportionate" to that described ih Appendix B (see "Survey 
Design") y The results of this selection process are displayed in Table' 2.1. 

On the basis of sample selection design, approximately half of the 
institutions- that completed Cycle I and IT ECMs in the 10 selected States were 
visited by survey .teams. - Using an 0MB- approved questionnaire, the team 

members sought detailed information on each conservation measure' implemented 
and on long-term continuation of the^O&Ms recommended in . previous program 
phases. Particular attention was given to o1)taining accurate pre- and 
post- installation energy use data. Valuable anecdotal information on Program 
operations and energy conservation techniques also v«s tollected during these 
site Visits. 1* * ' ^ _ . ^ 

Follow-Up Site Visits ^ 

All ECM site visit institutions that showed apparent increases in their energy 
use since ECM installat-ioTl were analyzed to determine the causes for increased 
consumption. Attivities in this task inclixled: review o^ both computerized 
and raw field data for errors; analysis of existing data to determine if 
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TABLE 2.1 'Sample siiE for ecm and ea site visits by' state 





^ 


Original Number of 
Buildings in , 
Sample , r' 


Number of Site 
Visit Buildings 


1 


Number of Sites ^ 
Visited^ 




> 

• Missouri 


TOTAL 
25 


ECM 
15 


10 


TOTAL 

J 

19 


ECM 
15 


EA 
4 • 


TPTAL 
18^ 

ft * 


ECM 
14 


EA 
4/ 


-: 


- — 


— *-2S- 


„ , X9_ . 


J 


28 


.19 _ 


? .. " 


-V 24 


^ '15 


9 




Utah 

Virginia 


13 
20 


- 11 
18 


2 
2 


13 
17 


11 . 

15, 


2 

2 * 


1^ 

15 


11 
13 


2 
2 




New Mexico 


/ 26 


20 
f6 


5 . 


26" 


20 . 


6 


18 


12 


6 




Oklahoma ^ 


19 


3 


18 


15 


3' 


17 


y 14- 


3 




Minnesota ♦ 


20 


15' 


5 


19 


14 


5 


19 


14 


5 • 




Rhode Isla;id 


' 19. 


13 


6 


19 


13 


6 


15 


10 

> 


5 ' 




New York 


7 


5 


2 


. ^ 7 


5 


2 


7 


5 


2 




m Inois 
• TOTALS 


24, 
200 

• 


18 
150 


6 

5Q 


22 
188 


17 
144 


5 
44 


22 
168 


17 
125 


5 

• 43 
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NOTES 

— ■ , , » * 

^The difference*1n the original sfte visit sample and the number nf site visits 
is as follows: 

» Missouri - 1 EA site refused the visit . ♦ „ , . 

* 5 EA sites were recommended after an other site visits in 
the State were completed 
■ Virginia - 3 ECM sites refused the visit • \ 

t Oklahoma - 1 ECM ^te was dropped from sample due to incomplete project 

. . .„ StfltM ' ^ — • 

• Minnesota- 1 ECM site was cancelled due to weather ^ ^ 

• nUnois - 1 ECM site and 1 EA site refused the visit 

^The diff,prence between the number of site visit buildings and actual site visits 
is as follows: Where more than one building of a complex is included- in the . 
sample, but fuel consumption metering was "provided only for a complex-, the number 
of buildings was. counted. as 1 site. 

) • ^ ■ 

/ 31 



Increases 
utilization' 



w|re due- to changes in weather, institution squarfe footage, building 

nf and/or aetering; visiVsV to selected institutions to verify 

initial analysis and identify internal technical factors that could have 
contributed to increases; evaluation of the data; and identification of the 
actions necessary to improve ECM operations and performance.. Figure 2.1 
* presents the analytical T>rocedure used for institutions with apparent. 
Increases in energy usage. ^ 

This Analysis resulted in selection of five .ECM\ sites for, return visits. 
Three of these were hospitals, one was an 311 electric high school and the 
remaining one was a chemistry building on a university canpus. - 

The follow-up site visits allowed approximately two* days at each institution, 
for the evaluation team's engineer to fully explore the energy systems and 
reassess the accuracy of the ^ergy data previously used for determining the 
resul^ of JCP participation by the subject institij{.ion. 




One major purpose of the rpt.urn visits was to iletr^minp whpfhpr th^n-t^ wprp 
specific instaHation, technical mor mdndq^^nMnt /' op'^rar lonjl^.^ rpl nm ^" ' - ' • 
the 1es$-than-expected enerqy consunption results suhspfft^vit thr 
tion of ECM's at the selected sites. ^ 




A secondary product of the return visits was i/qu<^H^y ''ontroi ^h^rk on 
findings of a11 site visits performed duriHt] fhe K^P . h i 'Jdt uin . [Hp doq 
of change in overall find-mqs, at this small samph^ or fai 'itu^s, notwppn 




extended follow-up visit and a relatively short initia 
level of confidence in the adequacy of the shor^pr vis 
method for the total of all sites visited. 



ANALYSIS 



visit prnv Hles sine 
^ ^ IS an *w a1 U'\f Ion 



Three types of data have been* identified for evaluatinq thp performance of ICP 
participants. First » quantitative data on fup^ cons iimnt ion identifies the 

savings of electricity, natural gas, oil, and' other fyels that were achieved 
throughout participation. Second, dat'a on huiMirtr] r h a r ar f er i s t i r s , 
administrative procedures, on-site observations by surv^^y teams, anij r^^sults 
of the TA review were included in the computer i .!Pd data base tor the uiirpose 
of cross-correlation with the fuel consumption data. 

Third, anceiiotal i n f ormrit ion is Pss^^nTial to rase 
studies and technical guidance reports, and bns bf^^^n ^ns^M amplify and 
interpret evaluation results. ' 

the analysis consisted of the fallowing pnncip^il procpMiirps ■ 

• Raw energy data were pfocess^d tor oarh site u'^nn VISICAIC 
software; this produced BTU totals by ^uierqy fyp^^ tor ^hp 
base year and latest year. 

• Totals for the raw energy rlata, -lionfj w'^h hn)ldin(j 
characteristics and adxni n i s trat i vp '*rv! f.u'hnif.H f i 1 d - v 
observations, were coded for entry mtfj ^h^ Statist ir/l 
Analysis System (5AS) software. 

• SA5 was used* as the primary analytu; tool, Thr^^n i^-mds ot 
SAS programs were used for various parts of thn .^nri lysis: 

- Frequency d istribut^ion , wtiich displays thp numhMr and 
^ range of values for each variable' j 

- Univariate anal ys is , wh ich calculates sums, mptms, md 
other statistical features for each v.inabU^ 

- Correlation analysis, which is used to caN.uIat^* and fpst 
the significance of^relat ionsh ips hp^wp^h f wn van.Uil^s, 
using linear regressii^n, 

• The three SAS programs were tjsed to ()rodurM anal /m^s of tho 
following types: ^ 
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- Energy and cost savings for the entrre data base; 

- Correlation between ECM cost, institution size, and 
energy and cxDsf sav ings ; 

- Energy and cost savings comparisons between various 
subgroups within the da^:a base, including: 

E(-M recipients and EA participants; ^ 

m 

0 

. Schools and hospitals; ,. ^ 

. Types jOf ECMs ; 



Groups based guestionna ire -responses ' <e , 

respondents answering "yes" or "no" to individual^ 
•^juestions) . 



These analyses were conditioned by the following factors: 

, t Weighting factors designed to amplify results to represent 
the original sampl ing. universe of Cycle I and II grantees; 
' (see Appgidix B, "'Sample Design"); 

• Probability factors which determine the significance of 
correlations between two varTablqs; 

• Tests used to assess the significance of comparisons between 
subgroups such as ECMs/EAs, schools/hospitals, questionnaire 
responses , etc , 



'Figure 1.7 show^ -the evaluation plan schematically. /Please refer to Appendix 
/b for details of the evaluation methodology. i^. 



PRACTICAL PROBLEMS WITH EVALUATION IMPLEMENTATION 

Certain circumstances had a bearing on the overall formulation akdjconduct of ^ 
fhe ICP evaluati«n. Many of these problems arose from the wide v^iation of' 
program administration at both the state and institution level s , Yequired 
some minor modification of evaluation strategies on a site-by-sfte 'bas>»s as 
. work progressed. Generally, however, these problOTS had no significant impact 
upon evaluation results. 

Problems associated with the overall formulation of the ICP evaluation 

included: \ 

» f ' 

% Preliminary evaluation planning during'early 1981 determined 
that the ICP schedule and the length of time required to 
implement ECMs- made evaluation of all cycles of the ICP 
impractical, since only 20X of funded ECMs had been 
rompleted by the start of the eval uat ion - in October 1981. 
In addition, the majority of completed ECMs were those which 
had been funded during CycJes I and II. Thus, evaluators 
were instructed to look aT only Program Cycles I and 11 , 




FIGURE 2.2 SCHEMATIC DIAGRAM OF THE EVALUATION 

"1. 



SAMPLING PLAN 

• Chose State 

• Pickad a random sample of EA institutions 

• Sampled al 1 complete ECM institutions 
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• Records of energy consumption were incomplete and/t)r 
unavailable at certain tjrpes of institutibns (e.g., public . 
schools, small facilities). 

r 

• It was often impossible to .isolate energy /cotisuinption> 
patterns at a siffgle building tbat was ^art of a central i-zed , 
energy system fon a larger campus or complex. However, this~ 
problem was mitigated during the final weighting of the site ^ 
visit Sample, and therefore, has no impact on evaluation 
results. . ' 

i Jhe nature of energy consuming -systfem^ and energy 
conservati-oo measures at many institutions makes it 
generally impossible to associate specific O&Ms or ECMs with ' 
definite increments of energy savings. As a result, the 
evaluatibn bas' had to focus on general, conservation 
performance by participating institutions. 

• In the case of certail? fuel type§ (especially fuel oil) , 
purchases -are on a seasonal or irregular (as-needed) basis, 
causing problems in breaking down fuel consumption to a 
monthly pattern. • ' 

• Personnel at institutions that participated .only in the EA 
'phase often evidenced lack of interest in and a limited 

memory abou^ Program events. / 

0 Some site visits to schools 9<!turred during vacation months 
when buildings were not In use, causing diff icul ties « in 
checkfng- on O&M implementation and .ECM, operating 
effectiveness. 
I » 

t States did not use uniform EA or TA fdrmats, and some States 
used EA checklist formats that do not lend themselves to 
analysis or field inspection. 

• The original design of the ICP makes selection of an ideal 
control group impossible. As- a result, no controJ group is 
available to use in comparing energy consumption>oatterns 
between participat'irtg and non-p&rticlpating institutions . 
However, a review of existing data on institutional/ energy . 
conservation, including variouis SEO evaluations of ^fhe ICP 
(comparing energy performance of 'pa'^'ticipants and 
non-participamts within States) provides aa opportunity to 
examine energy use i trends and to compare the effectiveness 
of ICP with these tfends. 



Other problems/ were spectfi^. to. the- site visits: 



§, In#many cases, site visit time ■ had to be- spent clarifying 
fuel consunption data. 




- In 'about 20 percent of the site visits the respondents 
ha6 not yet prepared the requested energy data but agreed 
to do so and mail it. In a few cases, respondents y«re 
able, during the visit, to provide, data in a format from 
which evaluators felt they could obtain the necessary 
information. 

' Another 25 percent of the visits required time with the 
respondent to resolve one .or more areas of apparent 
discrepancy in the data, ^.uch as the units J n which a 
. fuel was reported, or the reason why use of a certain 
type of fuel was initia,ted or terminated during the 

' course of the data period. 

- Iri a'few -cases, site visit time was used' to sort through 
and copy data f rofii a collection of utility bills or fuel 
delivery invoices that had not been organized or reviewed 
by the 'respondents. generally, such records^ lacked 
important information, or it could not be determined 
reliably that all the data w^re present, particularly 
where fuel deliveries were made on an irregular basis. 

bften, considerable site^ visit time had to be" spent 
identifying changes in utitizatidn, floor space, or energy- 
using equipmeitt that might have occurred j^ince the base-year 
period of energy data, . . 



- Ho5pitals were especially difficult to assess in this 
^regard because ongoing modernization charges -^frequently 
.involved the relocation of equipment into new spaces, as 
well as the replacement (or addition) of more 
energy-intensive equipment. The direct change in energy 
consunption is seldom docunented and' the indirect effects 
on heating or cooling are not measured. • Therefore, due 
to*their dynamic utilization patterns, many hospitals 
show changes in energy .use that is- not evaluated easily. 

At some institutions, the staff had changed since ICP 
^participation began*, and. information on implementation, 
dates, building modifications, and energy Changes was for 
tJiH reason uoobtainable.v 

Another frequently encountered difficuKy was determin^a an. 
aqcurate basis for al-loceting enfergy use 'to specific 
buildings where central metering afld/or a central 
heating/coo4ing plant was employ^. 

-•^ cases where both the square footage Of the specific 
_ buildirwg as well as the area of the total metered complex 
"Md changed, it was* sometimes not possible to be certain 
of the prorating method /applied by the bf"ig1f\al energy 
auditor and, therefore, it was difficult 'to ^pply an 
equivalent method to later data.- In addition, m«ny 
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institutions simply have not Jiad a previous need to 
measure their buildings or, maintain docunentation as ^- , 
renovations, changes', additions, closings; etc.'- Have 
occurred. , 

* ' I' ' ' . . , ' • ^ ' p. 

*t Few individual ' ECMs ^cah be yal idated :for tfteir • spec+f.ic 
, energy saving contribution because of the vack' of energy 

• consumption 'monitoring preceding and following-/' 

implementatiw) . * . 

- The likelihood of confirming the accuracy of projected ^- 
results from particular ECMs decKnes as facility 
complexity Increases, feven in' ra>e situations, wheipe only^ 
one ECM was Installed, a lack of contfol over all oTW . 
variables {or at least th^ docunentation of .cortcurrent 
changes in these variables) makes verifiable results -of 
the ECM- difficult. In facilities where usage and 
equipment are constantly changing {and hospitals are 
particularly dynamic in this regard), ene?rgy consiinption 
patterns are continually in flux. In *such cases, it is • 
-frequently impossible to" separate out the effects of . 
specific conseiH^ation activities. ^ . 

Changes in building use interact with, enfergy coaservation, , 
and true results are virtually impossible to t^uantify.* For* 
example, implertenting .energy conservation measures in ^a 
school gymnasium that also make it more attractive or 
comfortable may r^s\ilt in more use. of the gymnasium, thereby 
increasing its overall energy* cons impt ion. ' 

CHAJIACTERIZINS THE DATA 8ASE 

Definition of the Evaluation P.opuliatlon' . . 

This ev4'luation is based oll.a sample of ICP participants from Cycles I and II. 
"The sample includes: ' ■ ' . 

. • "-A s^ple of ECM grantees whose projects were completed by 
9/30/81. ' 

• A sample of selected EA-only participants. 

In the evaluation's analytic process, the ECM grantee sample was weighted to 
represent the national total of 1,012 Cycle I and. 11- grantees whose projects 
wer-e dbtipleted. as. of 9/30/81. Usually there is a ?ne year time perJod betw^ 
grant av«rd and ECM completion. For schools, this "lag" time .is eiplained- by 
the fact that any constnuction and equipment installation gel^erally is 
scheduled to take place in siflrmer when schools are not in session. Therefore, 
the niinber of ECfe compTete^ when evaluation activities began was l.Oit, 
conpared to the total of 2,853 ECM grants awarded during the first tw Program 
Cycles. To maintain clarity in .reviewing the evaluation findings, the 
following considerations should.be kept in mind: 4 



t The term "ECM grantees" in the report means CycTl^I and II 
grantees v4iose ECM projects were completed as of 9/30/81, 
' ni^ber 1,012. 

• Total Cycle I and II grantees nunb^r 2,853; hence the 
evaluation is based on 35% of all Cycle I and^II grant;ees. 

• Total ECM grantees, in Cycles I through IV number 6,270; 
hence the evaluation is based on 16%- of all ECM grantees to 
date. 

Elements of the Data Base 

-- . .. ■ ■ , ■ - ■ — ^ 

As mentioned earlier, the ECM sample was stratified by institution^ type, 
institution size, project coH, and, types of ECMs. This ECM site visit 
sample, comprised of 125 institutions (adjusted for multiple buildings),, 
included 106 schools (48 elementary, 44 secondary, and 14 colleges/univer- 
sities) and 19* hospitals. Included in the data base :are 96 schools (42 
elementary » 41 secondary arrd 13 *'col leges/universities) and 16 hospitals. 
Institution size' ranged from 6,162 sq. ft., to 1,365,175 sq. ft., with a 
median value of 56,245 sq. ft^, and project cost varied from, $720 to $775,000, 
with medjan value of $28,222. Thp impacts of these factors on eneroy 
performance are discussed in Chapter 3. Finally, the ECM sanple includes tne 
range and dtynbiViation of ECM types, v^ich were categorized as building 
envelope modifications ,rmechanica1 changes, lighting modifications, and 
special systems ECMs. • [Special systems . include solar systems and othec^ 
renewable fuels, as well as njodif ications to energy using systems such as 
swimming pools, laundries, and kitchens.] Discussions of these systems Jire 
found later in the "Findir^s* and "Case Studies" sections of Chapter 3. 

The EA sample was stratified only by institution type; it was composed of 11 
schools (4 elementary, 4 secondary, and 3 colleges/universities), 3 hospitals, 
^.6 local ^government buildings, and 4 public care facilities.' 

As mentioned above, no attempts ^ave been made to project the findings of the 
EA site visit survey to a larger population. Rather, analysis of EA sites has 

been conducted separately, and findings have been used to illustrate the ICP 
experience at selected EA sites. 

Site Visit Respondents 

In smaller school districts and particularly in the more rural areas, the most 
frequently . encountered respondent was the school system's superintendent. 
Most of tnese- administrators were able to handle the discussions by themselves 
but occasionally caUed upon other mefrtbers of their staff, most often their 
facilities director, financial director, or chief maintenance supervisor. In. 
many cases, the superintendent had personally prepar«l the docunentation, 
during the ICP, process and was also reasonably familiar with the technical 
/aspects of the buildings involved. In some cases, his office .was either 
within one of tHe ichuoi DviTtfirigs Of at "lesst ffgartjy in a support smtces 
building so that he had essentially daily contact with the facility and an 
opportunity to observe its patterns of use on a regular basis. 
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In larger (generally urban) school .systems the respondent was more likely to 
be the director of facilities and occa.sionally had invitgd the TA analyst. tp 
attend /along 'with this maintenance supervisor. _Ouring the walkthrough 
Nnspectlifons* the respondent usually acted as the main guide but sometimes 
deferred to the building's key occupant such as the school principal. 



Jn hospital site visits the main respondent was nearly always the facility's 
maintenance director. Also, he usually conducted the walkthrough with help 
from his staff if required on specific subjects. 
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Energy Data Definitions 



I 



In general, the energy usage, energy savings, cost- 
effectiveness, and payback data in this report are based on 
recorded .changes in energy usage at site visit facilities. 
These data have not been corrected for variations in 
weather conditions or other factors, such as minor changes 
in building operatiqn or equipment, due to a lack of the 
detailed building data needed to establish Mcurate correc- 
tion equations for each study site. In selected cases, 
ho^ni^t weather corrpction is applied to help "evaluate the 
perftwmance of individual institutions. 

if 

nerally, energy data are calculated by using the 11,600 
U conversion factor for electricity (the average aunber 
f BTUs expended at the generating plant that ultimately 
reduces and transmits a kilowatt hour (kWh) of energy as 
mfetered at the user's facility). Therefore, this 
conversion method reflects the BTU requirements for overall 
production and transmissipn of electricity, rather than the 
flTU consunption of an individual facility. Hbwever, in 
specific cases, when the' performance ot 1hd1>^al 
institutidns are discussed, energy savings are calculated 
on the basis- of a kWh valued at 3,413 BTU, which reflects 
the metered kilowatt hour of electricity used by a 
facility. ' / 

The data reSults in the report are al so subject to 
precision limits because of the weighting methods used for 
the analysis. In soromary, then, data should be viewed with/ 
allowance for vari at ions -due to: / 

• Weather conditions. 

a Changes in building (^ration and equipment. 

• BTU conversion methods. 

• Statistical precision limits. 

^ 

Based on data available, these fetors do not significantly 
change the quantitative findings 'In the report. 



CHAPTER 3. FIMDIN6S Al© COJICIUSIONS 

PROGR/M fiOALS 

Of other, secondary, goaly^ 1he>ogram*s primo-y goals are. ^ 

t To lielp participating inVtitutions save energy and reducd 
^ energy-related a)Sts. 

• To conserve oil and hereby reduce the nation's dependence 
on imported fuels. ^ . ^ . , 

Examples of secondary goals arising ^i^om these are: 

• The fostering of ■ energy-conservation awareness, and the 
stimulation of energy-saving activities on a national scale. 

• The advancement* of energy conservation science: by expand- 
ing its technical base of knowledge and the expertise of its 
specialists. ♦ • 

• An improved technical capacity fdr managing energy use in 
institutional buildir^s. • 

Has the ICP been successful in achieving its goals? The^ ^l^.l'?!^!!! 
fonnat: 

• How Vtell Has the ICP Been Administered? 

• Has the ICP Achieved its Prtnary Goals? 

• Wiat Secondary Goals Have B|^n Attained? . 

REVIEM OF FACTORS INaUENCIIffi JffiSULTS , 

'ihe findings and conclusions of this eval«ition ^^^^ .^/^,'??J" 
certAin predetennlned factors , disdussed in more - detail elsewhere Tn tr^s 
report, that may have an effect on' results: 

• The ICP^nding foraula required that 30X of Progrta >funds ^ 

• Teach^ate te set aside V ho>pU^^ Tfl^JS . - 

greSer competition among schools for remairving funds, and ^ 
may have limited schools' grant snounts. , 

• Itesiftners of the ICP intentionally focused on projects that 
^iwTy Sck quickly amt that would promtte the saving of 
oil; tte findings are. influenced by this orientation. 



Ihe States were given some latitude In the way they chose to 
conduct Program activities. 

Only Cycles I and IT We evaluated. The early {^ases of 
any program are typically fraught with ^t-up problaus 
that become Ironed out in later years. 

The evaluation has a very llinlted focus: It mainly analyzes 
the 1,012 aw grantees that corapletisd capital Improvements 
by September 30, 1981. This popula^ Is only 35X of all. 
the ECH grantees In Cycles I and II, and an even smaller 
percentage (16X) of all grantees to dAte (through Cycle lY) . 
The EA Institutions analyzed In this report represent less 
than .04X of all EA Institutions partlcfpating In the 
-Program to date. 
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HOU WELL WAS THE ICP AONlNISTERED? 



Trt hM»rn\ the ICP was considered by administrators and participants to be a 

^jfaSfe'l^l'llll'r^^^^^^ As dfscussal i"/^!,,^^i]rin"?tuSt on °"var' - 

dBktnm arMsvEd a hloh rate of participation of eligible institutions. »ari 

Sio^lf Us tapUentatlon. while theVn.^^ """^ 

energy savings with program administration. 

CONCLUSION: The ICP Reached a La rge Number of 
Institutions Purina the- hirst iwo 6rant cycles 

25X of Eligible Buildings Undertook EAs ^* 

ni.rinn Cvcles I and 11. over 65,000 EAs were conducted nationwide. I" the JO >^ 
?^nlil States EAs cwered aliiast 27.000/^uildir^s . or 25% of the^^ligible 
bt!??Xs w$fhin^e TirsT two Vle^ o^ the voluntary energy conservation 
program. . ' j 

• ■ 

Many TA and ECM firants Mere Awarded ^ . , 

Approximately 5.300 TA grants and 2.{J53 EC^ ^^^^^^,,^ZJ''tt^ S'uV^S'fcl^ 
during the first two grant cycles, covering }*'J36 *ind 5,960 ^b^^^^^^^^^ 
resoectively. In the 10 sampled States approximately 1.642 buildings were . 
c"^^ by 779 ECMVants. or approximately 2% of the tota number of eligible • 
^^h^ols i^d lisoitals in those States. However, prel iminary review^of ICP 
daSnrxlTcatS th;^^^ twice as many appl ications, were submitted as 

could be funded. , . , . i . v 

CONCLUSIONr Adwinistrat ive Practices ^ 
and Arrangements varied by state ; 

The aitainistrative process* interviews ^sought to, idenCIfy those varlationsjn 
Sate prog^^^^^ that may affect program Pe^/of^fn^e - wH^in a 

StatI T?t>1e '3.1 highlights these variations in Program -administration. ^ 
mll lL sp^ f ran tte- table.. States used various methods for procurifHJ matching 
o?w^am S^Js con^^^^^ data on eligible Participants 

?^1^ng plications, dev.e)opf^ energy audits, and conducting atxlHor and 
. analyst training. . 

of aidltoJf ^ "al^Ts nin«l b^^ the 10 States during the first two Progrjun 
cyc?« Wh^ei^ i^fstituti^ .^(fclinistrators and tecJu^al Personnel were 
t^aifed as eneray auditors, Ta'^ analyst .training genaTfUy ^ limited to 
•professional ei^neers and architect^ > • ' 



3-3 



ERIC 



45 



TABLE 3:i ADMINISTRATIVE CHARACTERISTICS OF ICT STATE 

SAMPLES . 



FLORIDA 



^^WD IN PARTNiRSHIP WITH FLORIDA PoWR CommJlON TO PfRf OfW EAS. 75X OF ><hlCH-HEREyERFORM£D , 
Bt IMOEPENneNT AUDITORS ' \ ^ 

, -* • 

• Strictest suikuncs and testing for auditoI and TA analystj;ertification of 10 States 

• Auditors requireo to have ntNimm 5 years of building maintenawce/manacement experience m 

ARCHITECTURAL 0||^NeiNEERl)lG DEGREE \ - ' * 

• Rigorous testing of TA analysts 

• Funded ecks on >«asure by measure basCs so applications could be modified t6 include only those ju)6£D 
appropriate by seo 



lamois 



• State's contribution mas all in-kind sctvicesj full ti« personnel staffed tw SEa 

• Independent contwuttor developed EA training, and DAT>f collection fo«is (difficulties with ^ 
•contractor left SEO with iNcowum rbBw*D8). 

i Any institution requesting REir»UR5£nENT FOR AN EA NAS REQUIRED TO AUDIT ALL OF ITS BUILDINGS. 

• Did not PUBLICIZE availability op hardship Fwbs. Only twse institutions requesting 

ASSISTANCE WERE CONSIDERED FOR HARDSHIP. 



HtfWESQTA 

• Independent unergy audit program in pi^lic schooiJs prior 



10 ICP. In 197tS^kj(r schools wre 
required to complete the federally prepared cowi/teR AUDIT PACKAGE Public Sc>«»l Energy Conserva- 
tion Survey (PSECS). In 1979 fwios.nere mai£ avaiu|l£ to other nwiprofit institutimis. 




Annual FI^EL and electric records are FIUD with SEO and HIIWESOTA tePARTMENT of EDUCATIOt 
"\ "(THEREFORE, P4iBLlC schools HAVE BEEN MOfT ACTIVE PARTI CI PANts IN THE STATE). 

•- SEO SUPPLEMENTED ICP GRANT CYCLE ^IWDING n;TH rMTViING FUNDS -FOR PARTICIPATING INSTITUTIONS, 

nissouRi ■ • 

• Initially State had difficulty locating matching fwids. , 

• STRtWG STATE SUPPORt OF ICP BEGAN .AFTER ftlOGRAM CYCLE 11 

• INSTITUTION REPRESENTATIVES TRAINED AS AUDfTWS CJJULO NOT CONDUCT AN AUDIT AT THEIR «« FACILITY. 



• Audits generally mere more generic and diq not always address an- iNSTiTurios's^f^Fic needs, 



NEW MEXICO 



• P^S AUDITS W€R£ WANOATOflY W -kX^ PUBLIC SCHOOLS. ^H€ SEO CITEU THIS AS THE MAf M ^ASON FOR HI6M PCliETflATriW 
AW JNCEMTIVE FOH PmHmM COffTlltUAJtOH. ^ 

• State supported schools are required to repwit on energy conservation actions in annual budgets. 

• State us£& ot)^ soiaces of fiwds to suppmt non> ICP energy cmscrvation pr(mram for local 

GOVEWWE^IT INSTITUnWIS, ' 
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'TABLE 3.1 (CONTINUED) 



4 



NEW YQftK 



• Substantial Statc su^pout «« iCP fticLUDCi) full ti« SEO staff of 25. 

• AOMimSTERED MME ICP FWtDS THAH ANy' OTHER STATE 

I 

• STATE APPROPRIATED PEA FUUDS PRIOR TO ICh SEO FELT THAT ICP WOULD COHJtNUE EVEN WfTHOUT ^ 

Federal fiwds, 

• S«ALU IMEXPfiUEMCEj) INSTITUTIONS SHOWED LOM PEJIETRATION BECAUSE OF EXCESSIVE PAPERWRK. 

. • UR6E BUREaWbACI^S (E.6.. MEW YORK CiTY) SHOW LOW PENETRATfOM FOR LOCAL GOVERW«NT BUILDINGS DUE TO 
DIFFICULTIES IN OBTAINING INTERNAL REVIEW? AND CV£ARANCES. ^ 

• HANDATORV PSECS IN PWILIC ELEMENTARY SCHOOLS ciNDUCTEIl PRIOR TO ICP WERE APPROVED AS EAS, 
AND THEREFORE THOSE INSTITUTIONS WERE ELISIBLE FOR TiftS DUJWNS CYCLE I. 

^ • STATE LEGISLATURE APPROPRIATED NO FUNDS TO SUPPOpTlCP. 

* • PROGRAM AUTHORITY WAS DEUGATED TO APPROPRIATE EXISTING STATE AGENCIES: DEPARTMENT OP EDUCATIO^I>. 
% to^D^F SrrPOR HIGHER EDUCATION, OKLAHOMA HEALTH PLANNING COMMISSION, AND COUNCIL OF U)CAL 

Gb>(£RNMENTS. PUBLIC CARE IN8TITUTI0.|S WERE -OVERSEEN BY ICP CENTRAL OFFICE. 

• ADMINISTRATIVE S^OCTURE .RESULTED IN DIV^SE^miNING FORMAt's, AUDIT PROCEDURES, AND DATA 
COLLECT^ON INSTRW^ENTS. * , 

Kmt tSLAWD . . *' 

, ENERGETIC EFFORTS OF ICP DIRECTOR ACCOUNTS /OR HIGH EA PENETRATION RATES, WHIC»1 FOR BOTH 
' SCt«5L^ AND WSPITALS EXCEEKD 95X. , ' ' , 

• INDEPENDENT CONTRACTORS DEVELOPED AND CONDUCTED AUDITS AND TRAINING, AND REQUIRED TESTING FOR AUDITOR 
CERTIFICATICM*. > 




. SIZEABLE STATE FUNDING F«. ICP DUE TO DIVERSE RURAL CONTING^Ncf OF NONPROFIT INSTITUTIONS. 

* • , INITIALLY SEO INVOLVED DIRECTLY IN TRAINING AUDITORS. CURRENTLY SEQ EMPLOYS STATE AUDITORS TO 
^OHIWCT AWJITS AT IHSTITUTIOHS, ■ 

VIRGINIA • S • 

' • . ^EO SOU^E OP AGGRESSIVE DEVELOPMENT OF NEW TECHNIOUES, "fRAINING MATERIALS, AND MONITORING 

ACTIVITIES^ ' ' ^ 

. 'sEO CONDUCTED cWrEHEMSIVE 6I»AMTS MANAGEMENT AND GRANTS APPLICATION WORKSHOPS, PRE-TESTING OF ^ 

iNsntuMEJrrs. • ** * - ♦ 

. SEO MAINTAINS AN ENERGY CONSERVATI^T^TLINE',' PREPARES ICP NEWSLETTER REGULARUY. AND CONDUCTS • ^ 
INFORMaJuMIN^RS on EmIERGY CONSERVATION. 

THRIU^HOUT ALL CYCLES, Wo J^Iijf^lNED AN ACTIVE ROL^ IN MONITORING INSTITU/IONAL PEHpORMANCE. 



T.ABLE 3.2 m^ER AND TYPE OF AUDITORS I RAINED IN 10 
\ SAMPLED STATES - 



J 




EA AUDITORS 








fAJMBCR 


TYPES OF PEOPLE TRAINED 


NUflBER 


TYPES OF PEOPIT TRAINED 


Florida^ 




c^.d^e^f' V 


319 


r 

•A,B 


Illinois 


2750 




350 


A^B^ 

1 


.llNNESOTA 




a«b<c«o«e 




A.B.E 

i 


niSSOiMi 


664 

i 


A,B,C,D.E 


Na9 


Na9 


I^M iteXICO 




A,B.C.D,E . • 


35 


A,B,E^ 


Nem York 


4600 


A,B<C.D<E 

/ 


fiA^ 


TTNi 


OKLAHOnA 




A,B,C^.D.£ 


Na9 


/ Na9 


Rhode (sland 




CD.E 






Utah 


266^ 


CD.E 




d . • 


Virginia 


1204 


A'B/C^O^E 


fl/A 


A.B 



Engineer 
Architect 
Buildup IUna^r 

riAlffTENANCE STAFF OR TEDMICIAN 



A. 
B. 

4). 



Administrative Personnel (such as 
school principal) 



. Other (specify) 



EQQUfilES: . . 

hSl Of EAS F^ERFORf^D 8Y INDEPENDENT AUDITORS 

"Florida reimj.ired MiNifiuH'5 years boilqing maintenance/hanagemnt 

EXPERIENCE ^. 
^FlORIM allowed ENGWIEER1N6 STUDENTS 
^IN CYCLES I & II 
^ftlLY FOT CYCLE IV 

^Heportvnq RE0UIR£^«HTS'0NLY > 
^ftoT FOR THEIR OltN BUILD1N0 

^iHFCmnAL TRAfNINGi C(K)RDINATtN6 AGEfCY PERSCWNEL PERFORM AUDITS ^- 
-AS WEU^ AW^STAFF OF ENGINEERING i^lRftS ALSO PARTICIPATE TAS 

%<.A, INDICATES DAJA N0t*AVA|U8L£ AT THf TIM^OF THE ADMINISTRATIVE 
PWJCESS INTERVIEWS, - 
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II 

Auditor aTd analyst JT-^/r/ta^r/- a^1l'ssrj» 

^ Z r^Xn^. TVsratl-U^toJ^ ^.^r. to pass 

a written test prior to certification. 

Training ^r TA -lysts was re^^^^^^^ o^e 
training ranged from 3 to 40 hours , ^t^^, /^^f y one State required 

State included wal k-throughs for analysts and wiy one 
analysts tq, be test'ed before they could be certified. 




Throug^ut the administrative p^^^^^^^^^^ 

a^nd again t^V//t^vL"e ^^^^^^^^^ program, designs and 

programs of its ^^6; "pwev®-. sev^ fdllowing sections, 

procedures were repoct^, as discussea in tne rwnw ■« 

SEOs Identified Severa? ImplementaVTon Problems . « . . 
Major' areas of concern wer«: ^ * " ^ 

. Tim^'and effort put in to implementing PEAs , when little or 

no use was made of them. ^ ^ 

• Cumbersome nature of the process )urr6^.nding d " - 
the State Plans and their review by DOE. 

• Restrictiveness of Federal .Prbgram regulations. 

• Technical atfin-inistrativi P'°^i^lHl.V^•„^t3?St1ons " ' 
' consistency) involved in the. manner by *<^^ch jnst^^"Vl itv 

' estimate nitu^ energy sav ings , as well as relat^- quality 
c^Mitrol problems With EA ami TA reports^ ^ 
' « inabilitv. td* fund a large enough State • staff to per.fom 

tion. ♦ . • , . • ' 

' , Recurring changes 1n Progra» funding Tevpls and, reaulatlons 
■ iiithout adequate nStlce to State offices. . 

• -.Nfcr^^^Aijtirv-^r^ 

grants) . . • ^ . , . 




These concerns were viewed largely as administrative details, and SEO 

Substantial Impact on participating 
Institutions' abilities to meet' program (Jbiectives, 

Certain Factors Influenced Participation Rates 

Table 3.3 presents the factors perceived by SEO officials as administrative 
barriers to part1c1i»t1on by Institutions; As the table irSicat^, s^e* 
SS*^f%rr^ ^''^""^^L^^.^P^*^ ^ significantly more limiting than others.' 
^l?/!^''!!^*/!^**!^.^ ^5*^ }^ ^^^^^y «*»in1strative barriers to 

alTAf.aK i^^^'^^r"" J'^ Institutlonrs were excessive paperwork or 
adninistrative requirements, ^ar of Federal or State Intrusion into their 
operations. ^d lack of funds to meet the Program's 50% matctyirequlremefit. 

Interviews with institution aAiinistrators corifinned these SEO perceptions. 
For etample. JiveraT EA-only sites reported that they did no't continue with 

■ t^l r^'^T ^'^'^f^ the efforts 'involved with the v^l Icaflon and re^rring 
^^ylT^S L^^vl^ ^" ^.^n^O". exceed the benefit of the grant award 

and/or the resulting savii^s. At some-larger hospitals and colleges that are 

•experienced in grantsmanship. It also iiis rejiorted that the amount of 
paperwork was excessive in comparison "b the Program's benefits. ^ Finally. It 
??JfI^S'"^^^?H!!I?"^ Institutions that because the ICP funding cycles may^iave 
differed fron t^lr own budget cycles, they were unable to seEifri the matching 
funds required for Program participation. . 

SEO officials also reported that ineligibility for ECM granti for local 
IZZ'^iTt^L^^^^^ ^VI f^^l^V^^ '^"ced their pailclpation rates, al 
fd\l^Jt^, presented in Table 3.4: Cycle I and irEA Penetration Rates 
and the Reasons for High or Low Rates.. / 

i^"^.* reasons . Cited fbr high EA "^netration rates included 
mandatory participation by State departments of education, as well as 
I'ha®l?'jf 4^? ^"^^!^ and Program marketing. Despite the concerns raised by 
Ji^in^i^;»*r^*^*"*^°"f generally comnented that the S€Os provided cooperative- 
a(in1n1strative support whenever it was requested. , 
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TABLE 3.3 ADMIN ISTRAtlUE FACTORS TERCEIVED- BY >E0 OFHCIALS AS 
• ; BARRIERS Tp PARTICIPATION BY INSTITUTIONS 




FOUm AND flEGULATtONS TOO 
COI«»L£X AMD CWFUSIHS 



Fear of intrusiw by SfAik or 
Federal gqverwmeht 



State schedule too tight 



Hardship institutions could 

HOT afford program 



S|ATE LACKED FIRS(»IN£L TO 
ADHINISTER. I CP 



State had difficulty comw^i- 

CATIKG WITH eligible WSTITU- " 
TIONS V 



Institutions didn't believe 
EA/TA i^ould be profitable 



Institutions attended trainins, 
^t didn't submit audit 



iNSTITutlONS ALREADY ASSESSED/ 
implemented CONSERVATION 
OPP ORTUNITIES 

LACK OF INFORMATION ON THE ICP 

INSTITUTIONS HIRED PRIVATE 
CONSULTANT S TO PERFORM yiDITS 

STATE TRAINING TOO FAR AWAY. 
LOf^ OR' INCONVENIENT 

Ori^R PROGRAMS CONSIDERED MORE 
DESIRABLE 



X. Not A FACTOR 

2. ftoDERATELY IMTORTAnT FACTOR . 

3. Significant factor 
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im£r 3A ZKtE I AND 11 EA PENETRATIOf^ RATES^ AND* REASONS 
^3 . )/f IQENflFlED BY SEO OFFICIALS FOR HIGH OR LOW RATES 



— 

STATE 


PEMETRATION RATE 
REASON ^ 


HOSPITALS 
PEJCTRATION RATE 
REASON 


LOCAL SOVEJUtOT PUBLIC CARE INSTITUTE ' 
PEICTRATION RATE> PENETRATIW RATE 
REASON REASON ' 


• FUMIOA 


62 




V 10l2 


^ 10S2 


Illinois 






0.9X 


0.3X 






« 


- No ECfl $ 


, - No EC« $ 


riff mmPcata 






i 

22X 






• • 




- State i PfwviDED 

help of League of 

Cities 
• 

/ 


- Poor cootdinatinq 
ASEi«:iE$ Fcw Public 
Care 

- No £01*1 








22- 


3X 


f 

• 


ft 


- Fea« of Federal 
intrusim 


•s 


- (ID tiA' S 




« 






2Z 




EAS !N ALL PUBLIC 
SCHOOLS f^VWDATORY) 


LACK OF INCENTIVE 
- f^BLEM WITH HATCH- 
ING Pl^B 


- No ECfl $ 

• 


- to' ECM $ 


/ 


SCHOOLS WST IfEPOHT 

ON Energy Conserva^ 

TION AS PART Of 
ANNUAL SUX^ET PRO- 
CESS 








tiEw York 


28X ^ 




20X * 


10-15J 








- NO ECPI » 


- No ECM $ * 


0Ki.AHOMA 


522^' 




121 


30Z 






- Hill-Burton and 
Oavis-Bacon a dis- 

ftCENTIVE 


- No ECM $ 


- No Ecn $ 

■ 


Rhode Island 
• 


~ ~ '■ 

96X 


iOOX 

* 


. 25^' 

- La:AL S0VEf01f«NT 

league did not FgUOM 
THROUGH ON PROMISE 
TO IMPLEMENT PR(^AM 


lOOX 


UTAH 


- SupwwT FROM State 
Office of Edikation ^ 


« 

* 




N/A 


yiRGINIA * 


n 


n 




12X 




* 

— « ' 




- No ECfl $ 


Ifp^ECfl $ 



V 



^Penetration rate is defined as the ratio of audited buildings to ELiGtfBLt-BuiLOiNas, . 
Florida rate by eligible autu^N^ g 



-'As of January 31, 1982; Schools: 51%^ Hospitalsi 53X, Local GovfenNMENTi m, a«d Pu8lic;Care! 23X. 3-10. 
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HAS THE ICP ACHIEVED ITS PRIMARY SOALS? ' 

The conclusions and firellngs presented below indicate-' that the Program has, 
indeed, been achieving the goals of helping institutions save energy, money, 
and oil. The docunentation of these evaluation artfas is complex, and so the 
• order ♦f the discussion is summarized below: ^ 



9 9 



Conclusion; EA Barticipants Experienced Limited Energy 
Savings . (A brief discussion of the findings concerning tne 
relatively limited EA sample analyzed) 

Conclusion: ECM Grantees Saved Energy and Avoidea Energy 
Costs . " ^ 

- ECM grantees achieved energy 

- EOf projects were -co St- effect! 

- ECMs pa i/ back more quickly tijan 




tions predicted. 



\ 



- knong ECM- grantees, schools and hospitals showed 
differences in energy performance. 

- Certain factors can. override attempts at energy 
y conservation (results of the follow-up analysis to the 

site visits). 

- Other studies support the value of participating in iCP. 

Conclusion; ECM' Granted Greatly Reduced Their Oil Usage - 

Conclusion; Certain Factors Maximized the Energy 
- Conservation Potential or iuk mnds _ 

- The iovlolvemait of personnel is as critical to saving 
energy as are doHar investments or installation of 
sophisticated equipment. 

- Thorough analysis of energy conservation needs as well as 
selection of appropriate capital Investments are central 

' to successful energy conservation programs. [ 

- Effective O&M programs Increped energy .savings 'T' 

- Ongoing mi^iitoring of energy performance is vital. 
These topics are discussed extensively in the following sections. 
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CWiauSIOli; EA Participants Experienced Liaited Ene rgy Savings 

— ' . • »^ ^> 

Institutions participating in the EA-only survey experienced m|n1mal energy \ 
savings. At EA sites, a total annual savings of 6,620 '"^1^?" ^^.^^ JS! 
achieved, or 0.4X of their pre-ICP consunption. Usage of\^- electricity 



\ . 
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increased, by 9,501 minion BTU. Most energy savings We at^hieved In n^tu/al- 
g^s (21,245 mill iwi. BTU) and heating oil (3,705 m|nion BTU). , 

Possible Reasons for Llislted Success ^ ' 

Since .the EA-only site visit sample represents less than .04* of the total ICP 
EA institutions to date, it is likely that the total BTU saving? by EA- p^rti- 
^cip^nts"^ is substantial.. However, during the site visits, the following 
'^factors were observed to have an impact on energy savings at EA-only sites. 



• At EA sUfes, audits often had been viewed as a one-time 
commitment of effort, "and ongoing energy . programs? did no% 
result. "This was partljcularly tn« at local government and 
public *care facilities, where there were no ackiltional 
incentives for energy conservation (these Institution types 
are not eligible for ECM grants). 

• • • ■ i 

• .Many local governments conducted "blanket" BAs at ^ al 1 

facilities within their .jurisdictions, and conse^ently EAs 
w6re conducted at some buildings (e.g., p^phouses, storage, 
buildings, motorpool garages, and city diinp werfgh- stations) 
that are neither occupied nor monitored a regular basis. 
For example, at one site (a comriunity center) that wa^. 
not regularly occupied," lights were turned on throughout tKe 
, building. The respondent conmented that because, of the 
building's irregular us.e^patterns , lights were tyrned on ih^ 
the morniag,. atnd then turned off at night, whether or not 
the building was scheduled for ise. ' ~ 

• In other cases , " such " as' school 'd1s£r1cts, hospital 
Gomple^^es, and local gpyernroeiTt^ , vliere audits had . beien 
conducted by a central office or by an independent auditor 

, not connected, with.- the instftution, respondents were 

unfamil iar vwith EA recbnnendations, or the fact " th^t EAs 
actually had, recommendations in them. At one hospital 
t complex, the Vespomient kr«w that audits had been completed 
• . for SQne of the larger" buildings, but, was surprised to learn 
that tl^ building selected for a .sit# visi^ haJ eyen been 



audited .V 



CONCIUSIPW: ECM Srantees' $aved Energiy^ gnd Avoided Ew^rqy CostsV 

-The sWsections that- follow doc unent the achievement'^^ this pr^ary ICP^oal; 
some provide direct, evidence mp others cdntain supportive / Information and 
interesting analyses about . cdmgpn en ts of the Program. T!«r^^cr^cs covered 
include the energy sav^gs Pf ytCM grantees,, the cqst-effectiveness^of their 
capital improvements, the'achli^ement.of their project*! paybacks, the energy 
saving-s of schools aid ,hosp1taH»^e findings of the iubanalysls that sought 
to determine the causes, of app^renv eoergy increases in certain institutions ,- 
and the result, of ^para'te studies that present- another perspective on ICP 
achievements. ' ' * " ' ' ' f ^ ' ' . - • 
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ECM'arantees Achieved Energy SBy4ngs 

♦ .• ' • . 

To meet one of the Program's primary goals of reducing energy consunption in 
non-prof it institutions, schools and hospitals received grants for the 
installation of energy ■ conservation measures -(ECMs) . The resulting ' energy 
savingsjfran these efforts were the equivalent of 988, 461 barrels of oil per 
year, and red"uced their avea-age energy use substantially. .Total energy 
savings are presented in Table 3.5. This table indicates that: 

• ECM grantees saved 5.17 trillion BTUs from the pre-ICP to 
post-ECM period. » 

t ECM grantees saved an average, of 13.2%* of their pre-ICP 
consumption. The average energy use index (EUI) dropped 

• from 258,255 'BTU/ftVyear to to ^29.129 BTU/ft^'/year over 
this period. • 

• Among ECfTg ran tees schools saved a total » of 3.13 trillion 
BTU annually* and an average of 21.6% of . pre-ICP 
consumption. iThe aver'age EUI for sciwoTs dropped from . 
136,323 BTU/ft^/year to 112,663 BTU/ftVyear during their , 
program participation. 

• Among ECM grantees, hospitals saved a total of 2.04 , trill ion 
BTU annually, and an average of 8.3% of presICP tonsunption . 
The avarage EUI dropped from 441.911 BTU/ft'/year to 405,551 

BTU/ ft^/^ear during thei^ part ici^t ion. s ' 



TABLE 3.5.,.ENER6Y SAVIN6S OF ECM GRANTEES^ 



Trillion BTU Saved^ Ayerage Perceftt Savings 
Schools . 3.13 21.6 

Hospitals 2;04 8.3 



Total ^ 5.17 " 13.2^ 



_ J , , ^ ^ . 

^ased on ICP Cytle I apd II grantees whcse ttt^ projects were complete^ as of 
9/30/81. . ' " . 

^From pre-ICP to post-ECM period, based on evaluation of electricity con- 
sunption at 11,600 BTU per kWh. ' 

* 

♦Based on statistical precision tests, the 90% confidence limits range from 
9.3% to 17.1%. 
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ECH Projects Were Cost-Effectlve 

ECM projects undertaken by grantees produced substantial ener'gy savings per 
dollar invested. An analysis, pf ECM cost-effectiveness for schools, hospi- 
tals, and total ECM grantees is summarized in Table 3.6. —The following 
canparisons of total dollars invested and total BTUS saved ind*icate that on 
the average, ECM projects were cost-effective: 

f Total ECM expenditures' for ECM grantees were $70.7 million 
(including both the 50% Federal grant and 5Q% institution 
matching funds) . . , % 

• Based on total annual BTU savings of 5'. 17 -trill ion 3TUs , the 
average c^t per millionr BTU saved annually was $13.68. 

• Tp determine the cost per million BTU saved over, the ECM 
lifetime, m average ECM life of 10 years was assuned.* 
Based on a 10-year ECM life, the cost per million BTU wo'uld 

• / be $1.37. , ' 

• / . ' . 

/• Since the Federal share of EC»^ projects was normally 50%, 
V_the cQst-effectiveness' of, the Federal share of EOI invest- 
fH^ts was approximately $6.84- perwpil 1 ion BTU. Over a 10- 
yetfjr ECM life, the Federal costMtr million BTU would be 
$0.%8 per million BTU. At mosti^val uation sites, project 
cost overruns were estimated to be less than 10%, which" were 
■ absorbeiT by the institution. When this is taken' into 
account, actual R^eral inVestaent was somewhat less than 
50%, and therefo^ actual (costs to the federal gover»wient 
wefe proportionately less.\ 

• The calculated ECM cost oln$h37/»1BTU compares favorably 
with 1982 national averager prices .** ' Overall, if it is 
assuned* that total energy wvings are attributable to, one 
fuel source, the $1.37 can canpared, to: electricity at 
$2d.01/MMBTU. heating oil at\ 9.35/MMBTU. natural gas at 
$5.23/F^TU, and coal at approj^imately "$3.57/MMBTir*** 



♦Ten years is used as an average for an ECM based on engineering judgement 
rathe* than statistical or empirical data. ECMs may last fewer than three 
yeary or more than twenty, depending upon their nature and i43keep. 

**For most ECM grantees, 1981-1982 fuel dita "have been compared to the 
•institutions', baseline consumption data to calculate energy savings^ 
Therefore, comparison of cost savings and national fuel ^rice^ also are 
expressed in 1982 prices. 

***fesed on 1982 national average, prices from Monthly Energy Review , U.S, 
D0E/EIA-003b (83/01).. 

0 ■ ' * 
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Mhfin 1982 average national fuel prices are adjusted to represent the mix of 
fuel types used by ECM grantees-, the average cost of energy Is . $7.89/MMBTU. 
When compared to the ECM cost of $1.37 per hWBTO saved, the result is that for 
ECM grantees, the cost of energy savings is extremely low compared to the cost 
of purchasing additional energy. 



^ \ ^ s ' . ^ 

TABLE 3-6 COST-EFFECTIVENESS .OF ECM PROJECTS 


L 


«^ 


SCHOOLS 


• HOSPITALS 


TOTAL 


. TOTAL ECM' EXPENDITURES 
{Mill ions of dollars^ 


45.24 


25.47 


70.72 


2 

Federal Share 

^ n 1 1 1 lOns UT uu \ \ OJ 3 f 


22.62 


12.73 . 


35.36 


MILLION BTU SAVED (annual) ' 


3,131.907 


2,037.746 


•5.169,653 


COST PER MILLION BTU SAVED 
(annual) (doUars) 


14.45 


12.50 


13.68 \^ 


Federal Share ^ 
(dollars) 


7.22 . 


6.25^ 


0* o4 

. ^ to . 


COST PER MILLION BTU SAVED 
OVER 10-YEAR ECM LIFE 
(dollars) 


' 1.44 


1.25 


1.37 


Federal Share 
(dollars) 


.72 

f 


.62 


.68 


^Based on Cycle I and II grantees whose ECM 
9/30/81. 

♦ 


projects were 


cwnpleted as of 


^Assuming SOX federal match; 

pletion resulted in a final 
*• 


in some cases, 
federal share of 


cost increases 
less than 50%. 


in prdgect com- 

-A 




ECMs Paid Back More Quickly Than Projections Indicated 

On the a^age, the actual time needed to pay for an ECM investment through 
energy cost savings (the ECM "p^ybacJt") was less than originally projected. 
The average projected payback in ECM applications during Cycles I and H was 
approximately 4.5 years. Data analysis shows that a tbtal of $70.7 iniili?" 
went into ECM projects ,* and that energy savings tptalled 5.17 trillipn^TTll. 
Applying 1982 national average prices to the mix of energy types yields an 
average cost per million BTU of $7.89 for the -post-ECM period. At this price 
level, the annual " energy savings of 5.17 trillion BTU would save $40,995,349 
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annually, resulting in a ,s1mpLe payback of 1.73 years. This is less than half 
the originally projected payback of 4.5 years. Assuming a 5CX- Federal share 
for ECMs, the federal payback becomes 0.86 years. Table 3.7 highlights these 
findings. The rdduc6d- payback finding may be partially explained by the fact 
that regulations called for "simple payback" calculations on ECM applications, 
meaning that enerigy prices were assuned to stay constant. Since increases in 
prices for electricity, gas, and other sources have increased the dollar value 
of 8TU savings, the calculated payback is reduced proportionately. 



TABLE 3.7 PAYBACK CALCUUTIOHS FOR EW INVESTMENTS^ 



TOTAL ECM EXPENDITURES 
(Millioni of dollars) 

i 

Federal Share' 
(^Mini(/ns of dollars) 

MILLlOD^ BTU SAVED (annual) 

WEIGHfED PRICE PER 
MILLION BTU*^ (in dolli 



iars) 



ANNUAL ENERGY COST SAVINGS 
(Mi n ions of dollars) 



SI 



PAYBACK 



SIMPLE PAYBACK ON 
FEDERAL SHARE - 



SCHOOLS 
45,24 



22.62 



HOSPITALS 
25.48 



12:73 



TOTAL 



70.72 



35.36 



3.131.907 2.037.746, 5.16'9,6B3 



7.89 
. 24.83 

J 

1.82 years 
0,91 years 



7.89 
16.15 

0.79 years 



7.89 
40.98 ^ 

1,73 years 

0.86 years 



1 



Based on Cycle I and II grantees whose ECM projects were cwnplete as of 
9/30/81. 

■Based on average prices for 1982 applied to actual mix of post-ECM energy 
types, weighted proportionally to BTU consumption. Price data taken from 
Monthly Energy Review . U.S. D0E/EIA-0035(83/01) . 
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%iong ECM Grantees. Schools and Hospitals 
Showed Differences In Energy Perforownce 

On some measures of conservation performance, schools were more effective In 
saving energy, and hospitals did better on others. An examination of tnergy 
savings by. ECM grantees by institution type reveals that schools |aved 
approxImHely 21.6% of their pre-ICP energy consunptionv while hospitals ^aved 
an estimated 8.3X (p<.05)*. However, hospitals display greater cost- 
effectiveness for their ECM dollars, averaging $12.50 per million BTU saved 
annually as compared to $14.45 for schools. 

' ' • , ■ • 

Several fetors were Observed to, have an Impact on the differences in energy 
conservation perform2iice for scfro'ols and hospitals. First, hospitals' overall 
energy usage tends to grow as new equipment and services are added. This 
L results in a rising "baseline" against which energy savings are meastjred, and 
thus reduces the apparent effectiveness of a given energy saving measure. 
Second, hospitals are nwre energy intensive than schools, due to the presence 
of a much greater amount of energy consuning equipment in hospitals. This 
means that the same amowit of BTU savings represents a smaller percentage of a 
hospital's total energy usage than a school's. Third, hospitals experience 
several restrictions on their operating patterns, dictated by such factors as 
Federal/State regulatory standard^ for ventilation, infection control, and 
patient well-being, and also have strict requirements for climate control 
(e.g., operating rooms, computar centers, diagnostic equipment) in order to 
carry out their prime mission of health care delivw'y. Therefore, although 
hospitals 'attempt to reduce operating costs, energy conservation may not be 
considered as important an objective as, for example, patient comfort, 
Security, or convenience. 

Finally, energy consumption and costs are more visible and easily identifiable 
in school budgets, and are more easily controlled by adnlnistrators. In 
addition, energy consumption may account for a larger percentage of school 
budgets, and more innovative and non-restrictive opport^jnl ties exist for 
energy savings in this type 'of institution. 





*p<.05 indicates that the difference between the two percentages is statisti- 
cally significant, 
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Additions of Unassessable ABWunts of Energy-Consianlng 
Equipnent. Inadequately Projected Savings and a Lack 
of Effective Energy Nanagemeht Can Offset ECM Savings 
At Complex Facilities 

Analysis of the follow-up site visits to ECM, grantees that increased their 
energy consunptiOB from the pre-ICp to post-ECM period reveal that ECM. savings 
cah l)e Offset primarily by three major factors:^? (1) additions of unassessable 
amounts of energy- cons uning equipment; (2) inadequately projected savings, 
and; (3) a lack of effectjjre management . Findings from the follow-up site 
visits are described below, and supported by five case studies presented later 
in. this chapter (Case Studies I-M) . The return site visits also afforded the 
evaluation team the opportunity to confirm its original evaluation method- 
ology, which is explained in further detail in the preface to these case\ 
studies. 

Additions, of Unassessable Amounts of Energy-Consuming Equipment 

Analysis of the follow-up site visits to ECM grantees that increased their 
energy consumption from the fre-ICP to post-ECM period showed that complex 
facilities (e.g., hospitals) tend to continuously add energy consuning equip- 
ment without maintaining records. This prohibits an accurate evaluation of 
ECMs based on the comparison of total buiuklng energy' consunption over this 
several year period. ^ 

Further, it was observed that individual metering or performance 
instrunentation on ECM projects which could permit savings measurements is 
seldom installed. In some cases, changes in operating procedures after ECM 
installation may actually cause reduced overall system efficiency, which 
cannot be assessed without instrunentation. Also, the normal degradation^ of 
ECK hardware efficiency with age and normal drift of control adjustment^ 
frequently cannot be detected without instrumentation. 



Inadequate Projected Savings Data 

Aiditianal findings from these return visits suggest that inadequate data on 
projected energy savings also compounds the difficulties of measuring energy 
savings at complex facilities. Technical analysis reports sometimes fail to 
present the projected energy savings in energy units for each recommendation 
so that the savings from a combination of installed projects may be deter- 
mined. Without this information, the apparent subsequent results cannot be 
evaluated for accuracy. 



Lack of Effective. Energy Management ' 

/ * ' * ■ 

Lack of an effective energy conservation progran directed from the highest 
management level of an organizati(»i . can fail to provide enough sBiled 
personnel to achieve energy-saving preventive maintenance, equipment fine- 
tuning, and hardware experimentation. At som5* facilities, the demonstrated 
savings potential could more than support the salary of an additional person 
to achieve the potential result, but this concept is not as read.i1y grasped by 

/ 
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management as is the concept of hardware purchases. Perhaps this is largely^ 
because managanent has historically considered the role df maintenance as^ 
simply to keep systems running, Now that energy costs are significant, the 
additional burden on maintenance personnel (and operators/ occupants) is. to 
assure that the systems not only run but that they do so efficiently. This 
calls for a considerably expand^ maintenance effort, and frequently for 
higher skill levels and/or more personnel than management may have come to 
appreciate. 

/ 

« 

Other Studies Support the Value of Participating 
In Advanced Phases of the ICP 

The studies, summarized below, while they cannot be tied to-th^ evaluation 
findings of -this report, do provide another interesting perspective on the 
ICP's achievement. 

• Maryland Schools --^ study by UII, Inc.* of energy a^nd 
related data from more than 1,400. school!^ in the mandatory 
statewide reporting system taalyzed energy use data for the 
1978-82 period. Their analyses show th^t: 

- ECM grantees saved a total of 26.94t of their ef>^gy 
, , use from 1978 t^ 1982. 

- -Non-participants saved 12.5% over the 1978-82 period. 

• Minnesota ScTiools —The State Energy Office** collected data 
in a voluntary survey of 173 ICP participants in the EA, T?\, 
and ECM phases. While this survey does not compare partici-. 
pants to non- participants directly, it does provide a basis 
for comparing ECM grantees to other participants. The 
analysis shows that: 

- ECM grantees saved an average of 14.1% from the 1979 to 
1982 period. 

\ - The group of ^73 survey respondents as a viliole saved 
..--^ 10.7% over theSa79-82 period. s 



- > 



♦Ene rgy Conservation in Maryland Public Schools prepared for the U.S. Oepart- 
ment of Energy by Unified Indyltrles, inc., March 1983. 

♦♦Minnesota Department of Energy, Planning., and Development, Energy Division. 
, I nstitutional Building Grants Program: Phas^ Two Prel iminary Report 
(Draft), April 1, 1983. '. . 
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AHAr Member Survey --1'hg Am.ferican Hospital Association 
undertook a suryey of various energy- related data frm its 
manDers. Tbe findings (based on 1960 data) include such 
-facts as: A _ 

r \ ■ 

-'Operating and maintenance improvatients occured*at a 25% 
higher rate among ICP- participating hospitals than among 
norv-partlcipants. ' ^ 

- In^hQuse energy audits were conducted at a rate 54X 
higher at ICP- participating hospitals. 



- Consultant energy audfts occurred at >M*ate 200% highe]^ 
among ICP partlclpantsJ^ \ ' ' 

- Capitlal expenditures •TOT energy improvements occurred ap 
a rate 46X higher among ICP participants. 



ECM Srantces Sreatly Reduced Tbeir Oil Usage 

Reductions in oil' use were the i^t outstanding feature, of the energy jsavings 
analyses; grantees saved more oil than any^^other energy source.' As mehtioned 
\at the outset, the ICP's ranking methodology for ECM applications was designed-^ 
flo give priority to those measures projected, to save' the greatest amounts of 
diil. This objective was. realized by the Program as shown by these findings: 

" ^ t Oil usage reductions by BCM grantees totaled U.77 trillion 
BTU areiually, or an estimated 2.25 million barrels of oil 
per year. . / 

• tetural ges usage by ECM grantees Increased by a total of 
8.78 trillion BTU; th^s was observed to be due primarily to 
a large number of oil-to-gas boiler conversions. However, 
adding the gas usages increase to the oil use reduction 

^ yields a net BTU savings of 2.99 trillion BTUs. 

• savings in other energy types were .mi nw 'approximately 2.18 
trillioiyBTU for electricity. LPGrcoal. and purchased steam 

^ — - combinea. . 

When oil use reductions are viewed separately from other energy sources, it' 
can be said that ECM exf»nditures of $70.7 million resulted in the reduction 
of 2.25 million barrels of^ oil use annually; this average $31.42 per annual 
barrel.- Over a lO-yefflf* ECM life, the cost per barrel is $3.14; and the cost 
to the Federal gov^nment (assuming a 50% share) would be $1.57. 

Certain Factors tolwized the Energy Conservation 
Potential of ICP Fung? 

The ICP definitely resulted in energy, oil, and dollar savings, but some 
institutional pfersbnnel— either throi^h good fortune, dedication, or 
interested analysis-fused ICP fuhds in a particularly cost-effective way to 
maximize savings. Th&st^ECM grintees who made the best- use of diligent energy 
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manager*^*- undertook accurate and building-specific energy analyses, and 
installed appropriate ECMs, persevered in the conduct of operating and 
maintenance techniques, and monitored energy usage shoved ^overall greater 
savings. Findings on these topics are presented in the sections that follow. 

1he Involvanent of Personi\e1 Is As Critical 

to Saving Energy As Are Dollar Investnents I 
and Sophisticated Equipment 

Coninitted Leadership Saves Energy ^/ 

Throughout ^the evaluation it was seen that energy performance w^s related to 
the level of couiijltnent of the designated energy, manager to the program. 
During tfte field survey, respondents were rated excellent, good, fair, or poor 
in terms of their overall involvepent in energy management. Institutions 
rated excellent experienced /avwage savings of 19.8X, compared to 9.0* for 
other respondents (p<.(»). For schools rated excellent, average energy 
savings was 20X compared to 12% for those rated poor. At .hospitals exhibiting 
high levels of involvement, average savings was 25X, whereas low levels of 
involvement experienceH 10% savings^ This is a strong indication that admin- 
istrators who ex ere 1 sew leader ship and are involved directly in conservation 
constitute an importat\^ element of successful energy programs. Figure 3.1 
graphically comparef^ the energy savings and cost effectiveness of these ECM 
grantees. As the figure shows, highly involved energy maaagars at hospitals 
can improve energy savings by 250%, since the complex nature of hospital 
energy systems require constant attention in order to maintain enejgy 
efficiency. 



Managers Can Save MoV'e Energy 
Than Some Sophisticated HachTnes 



V 



This finding was, particularly visible at those sites where ECMs included the 
installation j&f sophisticated energy management computer systems (EMCS). The 
dally efforts of a firy technically cqmpetent «id effective energy manager to 
make sure energy equipment functions' efficiently tm Improve the level of 
energy savings. Much of these savings can be attained by implementing 
preventive maintenance (PM) practices and improving operational procedures. 
Large reductions can'^te achieved initially by such simple means as installing 
time clocks, or by Ssigning one maintenance person to ^daily patrol of 
buildings for the- purpose of making e<pji<3ment adjustment, and detecting 
equipment inefficiencies and malfunctions at their onset. 

(^ce these management efforts are in place, additional energy i'avings can be 
achieved by 'incorporating, several ECW5, the most costly Seiog a top-of-th^ 
line computer-based er^erg^ managemait system. In one Institution, althot^tf a 
computer system provides desirable features such as- control monitoring and 
remote resetting capabjl ities , it has not contributed to/further energy 
savings, at the sane rate that the efforts of the effective, manager had 
achieved over a 4-year period of concentrated conservation efforts (a 75% 
reduction). This may be accounted for by the fact that the computer system 
assists the manager' in maintaining energy systems, but does not identify 
additional coi^servation opportunities. 
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FIGURE 3.1 

IMPACT OF^LITY OF THt ENERGY MANAGER (»< . ENERGY PERFORMANCE 
Question: Has The fnergy Manager Rated ExcpHent? 
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COMMIT: High quality energy managisf/s are important, to maximizing 
jgnergy savings. 
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At. several other instftutions that installed computer-controlled anergy 
managdnfint systems, a variety of conditions prevagted maximun efficiency and" 
savings' from the equipment (e.g., manual overridebf controU, improperly set 
*t1meclocks, cycling of systems in unoccuf^T^ areas, and^failure to connect 
some energy systems to the conputer) . 



The Organizational Level of the Energy Manager 

Can Affect Energy Savings - • s 

'in addition to the level of dedication by energy managers, the position of the 
energy manager within the institution's orgartizational structure can have an 
impaijt upon aiergy savings. Three variations of , frt^ram mjuiagem«it are 
described below. ' ' % . ■ 

On-site Managanent' *, 

At many rural school districtt, the Superintendent was^ responsible for all 
aspects of "the schools' operations, in dueling energy conservation activities 
and budget management. ' In^most of these situations, the superintendents had a 
very geod knowledge of the positive effects of energy conservation i>n 
operating budgets'. Most respondents were pleasantly surprSfied with the cost 
savings that resulted from'their energy conservation activities when viewed in 
terms of their avoided energy costs. I 

The result, ih these cases, was geierally a sincere and continued conmitment" 
to energy conservation. In addition, these respondents often reported that 
their energy aid cost savings fwompted their school boards to make firm 
finansial coninltments to energy conservation. ^ 

Centrally Located Off-Site Mwagament 

Many school districts and local government/^ften^Brlnt a central energy 
manager to oversee conservation activities In all b^^Ags within the jurls- 
dictiop.** Often the energy manager is a supervisor^^Buildlngs , and grounds^ 
wib has little pontact with daily building o per a ti^^^ Although there are 
some benefits to this type of management, such as gie capability to review 
vendor pyt)posals and m purchase equipment econcmically, there are . several 
areas in which this /type, of management may reduce the savings potential. For 
example, such a manager has no direct daily authority ov«* personnel who 
operate a variety ofybuildings aid Wio have little knowledge or experience in 
energy conservation.^ The result is that more energy may be wasted with poor 
daily control than the energy manager is saving throiqh wise fxirchasing. Case 
Study A pr^^ents a further exanple ©^--tfrfs^Trt^iation, 

In a similar^situation, a school district acfeiinistrator concerned with v«ys to 
save energy dollars was reasonably well informed on general technical methods, 
towever, the management approach was to allow each school principal to handle 
energy conservation within his ovn school. The results varied. greatly amo 
the schools, as shown in Case Study B. 

i 
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Internally Delegated Management 

Putting the responsibility for energy costs directly into the total operating 
budget of e^ch department at large hospital complexes and at universities and 
then returning a portion of conservation savings to that biriget the following 
year was found to be an effective incentive.- Many datly procedures account 
for the bulk of energy results, so that- tying responsibility to the manaoer 
who has daily authority ova* his facility's operation can produce good results 
at relatively low cost. It is likely that this opportunity for the manager to 
see the direct relationship between energy conservation actions and costs 
provides additional incentives toward savings. 




^lorough Analysis of Energy Conservation Needs 
s well as Selection of Appropriate Capital Investments 
Are Critical to Successful Energy Conservation Programs 

The Quality and^Use of Energy Analyses Varied Conprferably 

It was discovered during site visits that- the qualify and use of energy, audit 
information and of TA analyses varied to a *gr^at extent from one institution 
to another. Various aspects of this problem are worthy of discussion, which 
is presented below. « , • . 

Analyses Often Mere Not Building-Specific ^ 

EA and TA reports prepared for ICP participants varied greatly in quality, 
scope, and effectiveness. One conmon pattern observed, during site visits v«es 
that energy auditors and TA analysts tended to recommend the sTame O&Ms and 
ECMs at all buildings. In cases of buildings that are very similar this 
practice may be acceptable, but most seemingly "similar* buildings are in fact 
quite different in their energy' character due to the variations in mechanical 
equipment, utilization, nunbers of users, operating and maintenance condi- 
tions, siting, and other factors. For energy audits, this appeared more 
frequently when an outside auditor conducted EAs in a large number of dif- 
ferent types of institutions located in the same geographical location (e.g., 
the northwest part of a state). Jn a few cases, improper reconmertdations 
•(e.g., gynnasiun lighting modifications in a library that did not have a 
gymnasium) resulted. 

EAs Often Did Mot Serve As Educational Tools , ' 

Many respondents were unfamiliar with spencific EA reconmendationsv and it is 
doubtful that most energy auditors spent any significant time with institution 
management, much less maintenance management personnel, to effect agreement 
and^ motivation for optimim appl ication of the EA reccninendations. This situa- 
tion was seen in several institutions. At some institutions, where the EA had 
been completed a nimber «f years prior to th^ite visit, respondent soften 
were unaware of the O&Ms that had been recomnentHd. In seme cases, sifecific 
changes--such as. replacing 40-watt fluorescent barns with vatt- saver bulbs- 
had been incorporated into the regular mainjtenance program. However, lack of 

< 
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attention to many ongoing O&Ms such as recauUing, weatherstripping . turning 
off lights, and lowering therinostats and. domestic hot water temperatures was 
evident. 

' « * I 

EAs Did Not Guarantee the Implementation of O&Ms \ 

Where effective long-term O&M effort exists, it tertds to be ^due to the 
technical /energy conservation orientation of someorie aty the facinty j*fio is 
operating in an effective management role. The EA mayXhave accel^erated the 
identification of appropriate actions for this individual, when an flf^^' 
conservation advocate existed at an institution. On its >dwr, the EA did not 
Guarantee the ^plementation of no-cost or low-cost conseAvation activities. 
For example, it was observed that at 41% of both EA and EO\sites many recom- 
mended' O&Ms were not maintained, and that 62% of all sites hdd not implemented 
«iy O&Ms beyond those recomnended In the audit. In fact ,\managers at KM 
%-ites often freely admitted that the need to implement .the ves viewed 

largely or totally as adninistrative "hoop- jumping" in order to ^pply ^or TA 
and ECM funding. \ 

. • • • ' \ 

TAs Often Failed to Analyze -a ^ ,\ . 

Comprehensive'^rray of ECMs 

Similarly, TA analysts often either recomnended the same ECMs for a variety of 
build ings,' or nrovided detailed analysis for only a single "favorite ECM (See 
Case Study C) . For exanple. it was seen that only 42% of reviewed TA reports^ 
recomnended a full range of possible ECMs from which to seleG^ projects for 
fuf^nq. .One SEO official contended that for certain analysts, recommended 
Ecii'^could' be predicted prior, to reviewing submitted TAs. It seems reasonable 
tJiat at rnunimun. the TA for. such buildings should examine a [el?ji*ely'';f 
-nunber of-lbssible ECM choices and a demonstration of nonsuitability should be 
given in tfle TA for those ECMs ultimately rejected, as well as detail^ decu- 
menthtion on the'ratibnaHe for selected EC^fe. 

Many lA^. Neglected tne O&M Aspect of Energy Management 

Finally, many institutions perceived, the purpose of tit TA as qual ifyinft the 
institution to apply for ECM grant money. Thus, the overriding emphasis of 
the TA ahalsyst in such cases was apparently to Identify capital improvements 
that could save energy, rather than to present institutions with comprehensive 
energy managanent programs. Although the primary purpose of the TA was not to 
identify O&Ms, the most effective TAs/ were those that presentwl ^ . eneroy . 
analysis of the "total" facility. Fw example, while sane or -all of the ECM 
exp*»ditures * theoretically were productive., approximately 50% of the ECM 
grantees provided evidence to tte evaluation team that additional O&M efforts 
may have been more appropriate than the implemented ECMs. J^^T^}\*^.i^^^^ 
grantees showed -average energy savings of 1.7% at ^ °^ jili , «.u 
saved, on the other hand,, at ECM grantees v^ere- the need for fldJt|onal O&M 
efforts was not evident, average savings were 9.8% at a cost of $10.76/wbtu 
saved. Energy savings for schools and hospitals in these categories, as 
presented in Figure 3.2 further support the finding that there is a continual 
need for more and consistent (»M attention. Such attention might result In 
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- FI60RE-3.2 . * 

IMPACT OF OVEREMPHASiS m ECMs vs. O&His ON ENERGY PERFORMANCE 



Question :\as There -Evidence That Additional O&M Efforts 
ktottlil Have Been More Appropriate Than The ECMs Implemented? 
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the*0&Ms "outsaving- the more costly. ECM ^penditures. This is further illus- 
trated' by the. fact. that, only 39% of the reviewed TAs ^^conn^dedM^Ms 
the EA. In addition, sites whose-TAs identified additional O&Ms showed an 
average of 16/41^ savings, while those TAs not /econrier^ng additional 
showed an average of 10.3% savings. At hospitals. wherFdaily O&M attention 
is essential b the '^fficiency.qf 'complex energy systems. .T^ analysts may have 
had toa little contact with on-site' operating personnel to provide those 
personnel with technical ass.i stand 'that would improve iheir energy conserva- 
*tion skills. ,j This was evidenced during the TA review by the evaluation team 
which indicated tfiat *iiere TAs (ttd reconraend MHs beyond «ie EA. energy 
savings were almolt double the energy savings achieved by hospitals whose TAs 
did not consider additional O&M actions {see Figure 3.3). 

TAs Oftei Werd Not Examined Analytically 
. By Institution Staff ' 

The site-visit teams learned that .few TAs we^e 'carefully studied, challenged, 
or made widely available wUhin institutions for coordination and review 
befere ECM grant applications' were submitted. TTiis was particularly true at 
•tfhools Where TA analysts subnitted their- reports directly to DOE. and also 
vffeVe* responsible fpr preparing and submitting grant applications. At some 
schools. TA analysts failed to seek pertinent informatiw j^'T^ building 
occupants and jtiaintenance personnel of to' review the reconthended EP13 witn 
thaif. Not only did some respondents disagree with certain recormendatlons 
that were made without ' their knowledge, but also, this lack of conmunication 
led to incorporating ECMs that >CPntributed little to energy conservation, or 
reaulred extensive corr^tiver actfon. Examples of -this situation include: 
installation of vestibule doors .at entrances that had a hi i tor y of non-use due 
to the area of the school at which 'they were located; incorporation of a time 
clock on a donestic hot water recirculation pimp, even, tlwugh maintenance 
persQtnnel* kept the. pump^ permanently turned off; and recommendatioh of a boiler 
^ack danper that couTd not 6e installed due to safety considerations. At 
ichools where it was observed that alternative ECHs could have been more 
appropriate, ener^ savings averaged 12%; where appropriate ECMs nad been 
install'ed 'at scliooTs. the average savings was 20%. TTierefore it is Jikely 
that had seme fA analysts coordinated their, efforts with institution 
personnel , energy .results could have imjjroved. 

•/• . • / - : 

Factors Besides Conservation and Payback % y * ' 

influe nced ECk^eiecffon ^ 

'In atdition to the>|yback limitations for ECM projects, respondent^ 
a number- pf, other factors that influenced their selection of ECMs for ICP 
fund4n9. These factors included: , ^ 

"x 9 the availability of matching funds, . . » 

• '• The degree. to which the building's normal operating 

schedules woul^l be disrupted foi: ECM install at i«n. ^ r ^ 

• The operating* condition of existing energy equipment and the ^ 
degree to which some equipment w^uld require major repairs 
or, replacement within the near furture. anc} * ^ 
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FIGURE 3.3 
IMPACT OF O&M FOCUS IN TAs 



Question,: Were O&T^s Beyond The EA Recommend^ ions Included \n The TA Report? 
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t The degree to which the institution would consider install- 
* ing the ECM with their own funds, --v. 



EOS Observed Were Classified by Type 

ECMs observed^ during site visits were char^cigr; by type, and included: 
•< * ' ' ■ 

• Modifications of the building envelope (structural modifica- 
tions to windows, doors, roofs, and wafls), 

• Mechanical systems (boilers, pumps, HVAC systems), ^ ♦f- 

• Lighting ' (red uctidns and conversion from incandescent to 
^fl uorescefTt) , and 

• Sspecial systems (solar and other alternative fuels, 

kdtchens, laundries, and swinwing pools). ^ 

Certain ECMs Mere More Popular Than Others, 
But Were Mot Necessarily the Most Effective 

Combinations of these t^ur ECM types form 15 categories. Of the institutions 
that Installed only»one ECM, 21 were mechanical ECMs, 8 were envelope ECMs, 
and i involved lighting modifications. However, most ECM grantees installed 
multiple ECMs. The most popular con^inations of ECMs were envelope and 
m«:hanic3l measures (27 sites); envelope, mechanical , and lighting (18 sites); 
aril mechanfcal and lighting (12 sites). » 

During site visits, it was (^served that automatic controls for ])oilers and 
HVAC systans were tijfi most popular meqhanical ECMs. These included time 
clocks for automatic cyHing of energy systems and conversion of oil burners 
to natural gas with oil fdic backup.'' Envelof» modifications often involved the 
reduction of window areas *ith insulated panels. Some respondents at schools 
conmented that an initial ffear of a*lack of visual access to the outdoors from 
these ECMs was quickly /repljaced by more attentive students and more comfort- 
able classrooms. ♦ Other en/elope measures included vestibule installation and 
ceiling end wall insulation. Lighting modifications included the conversion 
of jntA^xJescent to'flu0f?scent lighting and the reduction of lighting through 
del'inping or replaeii^g existing bulbs with watt-saver bulbs. One common 
problan identified with delanping was' that alttwugh bulbs had been removed 
from fixtures, ballaltS^d not been, and therefore, potential savings were 
not being achieved . Examples of special systans ECMs were solar swimming pool 
heaters, exhaust heat recovery units, and a sawdust fueled boiler. 

It Was Often Impossible do'jtlnpolnt the 

Savings Generated by a Sffcrfflc ECM ^ , 

Since the structure of,-ICP prwnoted multiple conservation fctivities through- 
out m institution, the contribution of either 04M prdSmiv^s or multiple ECMs 
recoiwnended in EAs aid TAs both federally and non- federally funded, made it 
impossible to idCTtify savings due to specific ECMs. During the ECM site 
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visits, more than S0% of the respond«its reported that O&Ms were ongoing and 
45X of the sites were involved in additional energy conservation activities 
concurrent with IZP. However, only ^8* of the sites had specific metering 
capabilities. Therefore, in most cases, it was not possible to determine the 
actual savings of a specific ECM. However, it was possible to evaluate the 
improvements in building efficiency during the ICP participation period. 

At €ctoo1s, the 4 most popular categories of ECMs were (1) envelope and mecha- 
nicaH^Z) envelope, mechanical and lighting, (3) mechanical, and (4) mechani- 
cal and "^highting. A simmary of^ energy savings and cost -effectiveness is 
presented in Figure 3.4. These dafl$ show that schools, ECM popularity and 
resulting energy savings ha^e'an. inverse relationship (e.g., sctiSliii^ instal 1- 
ing the more popular ECM categories achieved the least savir^s). Hovfever, for 
hospitals, ECM selection shows a direct relationship with overall building 
energy savings, which suggests that hospitals may have had more technical in- 
sight into the energy efficiency of selected ECMs prior to installation. BCM 
selection for both school's aijd hospitals shows no correlatim with cost effec- 
tiveness v^ich is due primarily to the fact that actual cost-effectiveness 
cannot be assessed prior to installation and operation of ECMs. 
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ECM Qual Ity Was Good 

Generally, the quality of ECMs was (^served to be va^y gocxl. Sixty-four per- 
c ent of th e projects were rated excellent of gotxJ in terms of their operation 
and upk4«p*-wiiereas only 4% were rated poor. Only 12% of the respondents 
reported ««y problems, alttough the evaluation team observed operational and 
upkeep problems at approximately 20% of the sites. This difference can be 
accounted for by the . lack of technical and/or engineering knowle(^e on the 
part of the respondent. .Problems most often occurred at those sites where 
advanced technologies and innovative EC^fe had been installed, and both 
contractors and maintenance staff were isifamiliar with them. The effects of 
these problems usually was evidenced by energy savings that were far below the 
projected savings. For exanple, at sctools where ECM operations and i^keep 
were rated excellent,* averse energy savings were 22%, as opposed to those-^ 
sites viiere problems /were observed, which averaged only 11% savings; For 
hospitals rated excellent, energy savings were 21%. 

Use of Advanced or Unusual ECM Benefits 
Froo Prior Proof nf Perfomance ' 

Where advanced w unusual ECMt are installed, their performance may better be 
assured by using a contractor with previous -experience with the ECM, or ^ 
requiring prior proof of the^CM's energy performance. If this "track record" 
is not available, then the institution involved should be adequately cautioned 
that such an undertaking is a research and development f*"oject and that thay 
should have follow-on funds identified and available to assure eventual 
sucGBSs. In cases where ne>* and innovative ECMs have been installed, design 
and operational problems often have been encountered. For example, at on^" 
site, a sawdust boiler had been install^^^ replace the School's fuel qtl 
boiler. It was determined subsequently that' the combustion rate in the saW^' 
dust boiler limited the output to about one-third of its capacity. Insuffi- 
cient consideration had been given to the problems associated with mpisture 
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FIGURE* 3.4, 

Energy Perfprmance of Commonly Selected ECM Categories* 
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content of the sawdust. Al though - prel im In ary anilysis projecbsd ' total 
replacement of fuel oil, the school had rediiced its fUel consunption Iby only 
50t. At the time of the site visit, the school v«s in the process of inves- 
tigating the costs for optimizing the system* i efficiency. Even though school " 
officials had no specific estimates at that time, i$. was concluded that the 
cost ^fectiveness of the ECM was gre^atl^ reduced. Other innovative ECMs 
encountering problems included incinerator heat recovery, exhaust heat 
recovery, and seme solar applications. \ ' 

On the other hand, one school was visited that installed a boiler interconnect 
system which, it waS'-ei^im^eb , could eliminate simultaneous operation of half 
of the school's boilers. Althowh initial problems were experienced, the TA 
analyst worked closely with the-'iron tractor to correct the system, and within 
the first year of operation the school showed a 36% reduction in energy 
consunption and had saved $35,000 (see-Case Study E) . 

Effective Operations and Maintenance (04M) 
Programs Increased Energy Savif>gs 

Field survey teams observed' that several ECM grantees were not maintaining the 
O&M measures reconwended in their energy audits. This group saved an average- 
of 3.2% compared to an average of 15.6% by KM grantees observed to be keeping ' 
•4) with the O&M measures recomnended in their audits (p<.05). ECM grantees 
observed to be maintaining O&M measures beyond those resulting, from the energy 
audit experienced 15.9% average- sav ings , compared to 7.7% average savings for 
those who did not pursue O&Ms beyond the aiergy audit (p<.05)% 

This difference is also visible in the area of cost. Grantees maintaining 
their enerfay audtt O&Ms spent $27.79 per WBTU saved by their ECM projects, 
versus $14y.52 per mBTU fcr those that .did not maintain their O&Ms. Those 
that pursued O&Ms beyond the energy audit spent $27.60 per ^WBTU saved. 

This relationship between strong O&M progrons and energy savings also holds 
true when schools and hospital's , are examined .independently. Energy savings 
and cost-effectiveness data displayed in Figures 3.5 and 3.6 indicates the 
extent to which neglect' of O&Ms reduces -energy savings as (^served by the 
evaluation team« • • y 

I is clear that thorough, ongofng O&M efforts are associated with greater 
energy savings, and that, ECMs can be more effective when supported by a strong- 
O&M program. ECM grantees selected certain ECMs %r various J^asons, and the 
most popular were' not always the JW)st efficient. However, selection and , 
maintenance -of ECMs are essential to the Khievement of a successful energy 
consen^^ion program. -t • , 

. I ■• 

Ongoing Monitoring of Energy Performance Is Vital 

Ongoing monitoring of energy consunptiqn provides* the basis for evaluatir^ the 
success of an institution's energy conservation program. Reviewing and com- 
paring monthly fuel bills and adding ^equipment metering are two effective / 
methods for identifying the areas of potentially greatest savings as well as^ 
quickly pinpointing consunption- increasing problems. 
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firnm 3.5 IMPACTS OF MAINTAINING O&MS 
Question: Is There Clear Evid«ice That O&Ms Are Not Being Maintained? 
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FIGURE 3.6 IMPACT 0F THOROUGH O&M PROGRAMS ON ENERGY PERFORMANCE 
-tjUestion: Was There Evidence of Additional O&M Activity Beyond the EA RecoBfliendatlon? 
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COMMENT: 



O&Ms exceeding EA recomnendations contribute' to higher energy 
savings and better ECM cost effectiveness. 

J-34. 



76 



ERIC 




"Save 



£nergy 



Mo9itorinq and fteterl 
$97.74 for.M*1BTU for those without monitoring. 

6r^t«s with special metering ~Tnro5'f''lne^V?ost; "^Zitnt 

9« for grantees without special metering (p<.05). Energy " "'„.'^„ 

tions vrith fecial metering were $13.05 per WBTU saved, f^^^f" * »"3*S 
pe? HMBTU sav^ at institutions without special metering. g9«^^ 3-^ 1:° 
?Larize the impacts of monitoring- and meter|ng on energy performance for all 
ECM grantees; as well as for schools and hospitals. 

^JsvT^O.mA%i^. s^^TJ^meTe^i^ ""At 

^SXir^re"SergT-n?^p^ n «s"XV?^ul^^ a'^eraged . 

Sras l^i^^ tTfu savings W hospitals that did not monitor. 

' ' * . * .. - - . 

Results Must Be Analysed and Applied • ' . 

Although- the EA. lA. and ECMs J''^«"l^,S'l!5*i::;\S SSiilsfratJfeTr 

• ^j^aWTof M^^^^^^^^ f S^;°'i:e?e^nrhij: 

r tne^-^rSole r r^V-" V^^fio^^^^ 

-fllnl- T ^ Si^V-thaf I'i I 44¥S3Siel^ 

S'-Nrs'in-rde"sT'd^;e?"' nK^s"ljfe hTtt^ m^^^re^staff to 
use the monitoring rjeports for energy conservation. 



Theoretical Savings 



Often Are Hot Challenged 



efew cons»Sti<». this "blifd faith" is even more prevalent. In the few 
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FIGURE 3.7 

IMPACTS OF M(»4lT0RING ON ENERGY PERFORIWNCE 
Questloy.* Was There Evidence Of Ongoing Energy Data ^ton^s$or^ng? 
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FIGURE 3.8 

IMPACTS OF METERING CH ENERGY PERFORMANCE 
(Hiestiom Mas. There Evidence Of Special Energy Metering? 
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COMMENT: Spec iiaV metering contributes to energy savings in a very cost -v 
'effective nanne> - 



case§ iiAere energy budgets have been decentralized m6 management authority 
has been placed in \th^ same hands as the operating and maintenance responsi- 
bility, there appeirs to be more dynamic monitoring which produces better 
results. This topk is discussed further in Case 'Study F. 

Maintenance and Monitoring Contracts 
Cin tlntail PiTTaTT? ' — 'Z 

Long-term mairt^enance/monltoring contracts for ECMS involving changes to (or 
. addition of) mechanical equipment controls can not always assure proper 

functioning and optimun tailoring to the ftcilities' needs. Observations and ' ^ 
discussion of the functioning of such ECMs has disclosed that improper mainte- 
rjance and/ or. monitoring can cai«e significant difference between theoretical 
and actual per form ance. ' For example, in one case controls that function only ^ 
in the winter mr^ install^ and set in the sisnmer. Problems reported during 
the winter were adjusted/ the following spring. The n&kt winter the same 
complaints still existed ^d were. observed during the site visit to be of a 
nature that probably co^ld not be corrected properly except during winter 
operation with actua.1 h^dt load' conditions prevailing. The result was poor 
energy conservation rjes^lts existing long after savings should have, occurred . 

In some cases, the onfsite personnel are not considered sufficiently capable 
and/or are specifically directed not to concemr themselves with the mechanical 
equipment and control^. The incentive to observe aid report apparent ineffi- tf 
ciencies, let alone ^ take any action, is thuj directly affected. In .other 
cases viiere the on-site personnel appear to bi nominally qualified by experi- 
ence and position, /there are still questions of how efficiently hardware is 
controlled due to/ lack of analytical instrunentation aid/or insufficient ' 
willingness and timfe to'Obtain the optimun settings experimentally. 

One school that contracted with a local maintenance service company to "perform 
^)eriodic preventive maijitenance throughout the school did not assign anyone to 
monitor or judge the contractor's work, or to coordinate appropriate equipment 
operating proced6res and- control set-points with , the school personnel • and 
mission of the facility. ^ a result, money was being paid for ineffective 
service, as evidenced by the following seven items noted during 'the site 
visit: dirty filters, overflowing cooling tower basin, classroom gas unit 
heater pilots l/eft wj throt^hout the suniner, domestic hot water heater set at 
maximun temperature, cooling of isiocci4)ied areas to 65 F, empty refrigerator 
set to lowest/ possible^ temperature in sinmer, and water ' codecs operating 
during unoccupied summer periods. 

/ ' * • « 

The impl ication. is that management of an organization must be motivated and 
knowledgeable in order to select a professional maintenance service that will 
do more thah react to broken equipment. Managers must either know how to 
select a Suitable contractor, or must provide well-defined performance 
requirements and continuously follow up the contractors' actions until assured 
that work /is being done in a manner that will maximize energy savings. 

A viable /solution to increasing energy efficiency from complex control ECMs is 
to recogtiize the need for more highly trained personnel to colriuct follow-on 
: measurKfients and correctipns than is normally needed when onl^ operation of 
the equipnent. not efficiency, is the objective. This requiremenf can be met 

/ ~ • * 
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in' several ways hut all have a cost. The f^^'bejeflt ratio' should 
futlu assess^ before such ECMs are incorporated.. If no solution can oe 
. it Vbe tet?.r to diyert the. proposed ECM money into even Ipnger 
payback -Projects that xequire no close fqllbwron attention. • ^ • - 
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WHAT SECONDARY GOALS WERE ATJAIMED? 

\ The ICP achieved several its secondary goals. 'In general, they fall into 
two categories: (1) t||fe stimulation of energy awareness and. conseAat^on 
activities, and (2) a widening of interest in energy conservation and a 
concoml^t growth in technical expertise. The pursuit of -a third 
goal --con>«erat ion ©f solar and other renewable resources— yielded unevai 
results. ' 

The ICP Has StltMlated Eaergy Awareness and ' *^ ^ 

tnergy conservation Act it?^1ties <^ 

Throughout thie site visits it was oJjserved that the ICP has, been effective In 
promoting energy conservation- programs: in schools and hospital . Evaluation 
. data that support this finding are Shown in Table 3.8.- 

« 

As .Table '318 indicates, 72% of the grantees would not have been involved "in 
energy conservation without the ICP. When ECM cost effaQtiveness data are 
examined for- schools .and hospitals {see Figure 3*.^), /ltw)ears that for 
institutions that would rot otRerwise be involved in energy -conservation, the 
Program provided a necessary financial incentive. However, the eneirgy savings 
data suggest that those ECM grantees *yho would have instaMed their ECMs with- 
out the ICP may have had a betXer uf«lerstdnding of the more energy efficient 
ECMs, since overall, this group achieved higher^ergy savings. 

In summary, the ICP is effective in reducing energy' cons imp t ion in schools and 
hospitals, and in assisting these institutions develop eneSrgy conservation ' 
programs that are likely to be sustained with their own resources. 

ICP Has Resulted in a Widening of- Interest , ♦ 

in Energy conservation and a ConccmUant , - . 

Growth in lecnmcai Expertise " ' 

In addition to the energy savings associated with the ICP, evaluation data 
reveal that the • Program \s attaining, a nunber of additional goals and 
objectives. At the admifvistratlve level. State Energy Office (SED) personnel 
reported that the benefits of theJCP extended beyond actufl fuel savings for. 
participating institutions. Additional benefits cited include: training arftl 
support»of energy ^ conservation specialists (enfllneers, aud1t«H, and 
monitors), and generation of basic data bases on bui Id ing, profiles and\eneraVt 
consunption on a State-by -State basis. ' ■ ^ 

r 

- In addition, several States have Initiated energy conservation programs as a 
result ^f the ICP. Although designed around the ICP, these State prograns may 
Include alternative funding mechanisms such as low-interest loans/ revolving 
loans, afld shared savings, as well as -d-irect grants to institution^. SEOs 
al-so noted stimulation^ of Interest in the energy savings potential in non- 
el igtble facilities. ,, . * 
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V ' TABLE 3.8 

(NSTITUTIONAL energy CONSERVATIWi; involvement 



' % INVO-VEMENT' 



ACTIVITY 



.AH Iiistitkions^ 



Schools 



Hospitals 



18 



ECM granle« .with 'no 
' % •, I involvement in energy « • ; 
^ I conservation prior to " . ^ • cc 

' the. ICP . \ • . '65 

,ECM grantiAs that ^ 
dmiflementea non-ICP 
funded energy .projects 
*\ since p.articipating 
' .in the ICP 

ECM grantees exhibiteid 

awareness of energy . ^ . 

conservation through . " 

rgninder , signs and 
posters thrqughout 

the/bUil.cfilli^i^^^^^ y r.^^^-^ 

ECM grantees reported 
.that proj«ts v«<Jld . 
. \ -rtot have been 
undertaken Within 

5 years witho^it ICP , . , . • n - , . - 36 

fMnding. : - . 'V 7? ^ • _^ . , 
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18 



V 



[eCM grantees if«porled : 
specific cohs6r*vatlon. 
Mtivii^ies •planned fpr , 
the future '. » • , 



65 



'Based w^k^'iieighted sarop^ pf J^H ^ranfte^s. . 
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,^ FIGURE 3.9 . 
ICP AS AN INCENTIVE FOR^ENERGY CONSERVATION 
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COMMENT: ICP. clearly provided the' f i^iandlal incentives for schools 
♦ . ?fid h'Qspltals to undertake conservation activities that 
they;othervf1se.*fould not have 'done. 




A nalysts Couldn't Agree on the 
Cosi Effectiveness of !>olar blMy 

Because the ICP requir^'the cpfisi deration of solar and other renewable energy 
measures. States usually gav©^ extra credit to those applications during grant 
ranking and funding. .Oespltl this extra^ credif . few TA analysts were able to 
justify applications the long paybacJc of such projects. However the 

site visit teams found that whereas most TA analysts' projected a very long 
payback for a particular solar project, at a few nearby instUiitions the same 
project had b6en funded. For exjmple. in one. camera TA analyst concluded that 
solar heating of a school's Indoor swiimting' pool would have a 46-year payback. 
At another school within 30 miles, the anajy*t7calculated a payback of less 
than '14 years, and sol^r pool heating was redommended, approved, and 
installed. ' ^ - 

TA analysts in another State were generally in agreement that solar heating of 
donestic hot vlTater in schools would have an excessively long payback. How- 
ever*, one analyst found the payback to be quite short and recommended this as 
an ECM. The EOl was approved and installed even though virtually- no other 
sofar prefects had been approved in that StatV. No instrUnentation or other 
'means of performance evaluation was included ^ planned, so there was no way 
for the school to determine whether the solar (project was effective. Further, 
there was no provision to prfcy^the appropr^eness of the analyst s unique 
reconmendation . * | 
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ICP CASE STlffllES 

In addition to the quantifiablie data on fuel consumption 
.in institutions and the qualitative and adninistrative 
details of ICP participation, each Institution visited 
provi^led interesting information on the attitudes and 
behavior of building occupants and users, as well aSvSpme 
, insights into the impacts of these attitudes and bejwvior 
on energy conservation. Although extensive ai^dotal 
information is beyond the scope of this /report, 
institutions that represent a mix of survey delivery (EA 
or ECM) , institotion type (schobl, hospital; local 
government), size, and location, have been .selected as 
case studies. These cafe studies support spetific 
evaluation findings, descri^)e the technical application of 
O&Ms arid EOte in combination with daily in^itutionaT 
procedures, 'and highlight the ICP experience" in these 
ini#i tut ions. 



CASE STUDY A: THE EF FECTIVENESS OF A CEWmLIZED CONSERVATION PROGRAtL 



tM \^\mit i^i mk 6^ Pft kk&Oftg^At M BUILDINg LEVET 

Institution Type: 



Location: 
Size: 

Latest ICP Phase 
Completed : 

EUI: . 

Fire station- 

Base: 
♦ Latest : 
.Health clinic 
Base: 
Latest: 



2 local government buildings 
(fire station and health 
clinic) 

Large urban 'area 

Fire station: 6,912' sq. ft. 
Hea\t;h clinic: 986 sq. ft. 



EA 



126,591 BTU/ft'^/yr 
256.636 BTU/ft^/yr 



156, BTU/ftVyr 

ni^ ■ 2 ' 
133,884 BTU/ft^'/yr. 



Savings: 



Information:. 



-Eire station * 
Health clinic 



- 103X 

- 14.6X 



Fire Station EA'completed: 
4/80 . - • . 

Health Clinic' EA completed: 
10/79 



Th« city's energy office, which has been in existence since 1975, coordinated 
the ICP. A knowledgeable energy manager was appointed to conduct EAs at over 
60 local government i buildings as part- of the ICP, and two buildings were 
selected for EA si ^visits. ' • 

Purchasing authority and the research efforts of the energy manager afford the 
city the ability to buy ^ergy- saving e(Ju1pment at reasonabTe prices. For 
example, the manager discovered that it was cheaper to buy a 4-lamp, 2-banast 
fluorescent future and comiect only 2 lamps ^nd 1 ballast than to buy a. 
2-l.a©p, 1 ijallast fj;<ture. v ' * " : ' - ' • 



However, the manager has no direct' daily^ authority over personnel who operate 
a variety of buildings. The risult was that more energy sjyas wasted with. poor 
dally control than the manager Was savjng thrc^ugh special purchases. At- the 
fire station, all window air cdWitioners were operating to produce chilling 
temperatures, and lights were on in the sleeping areas in the morning, even 
though no personnel were ijsing thg area. "In addition, incandescent lights of 
excessive wattage were lit in • stairwel 1 s during the day. despite the 
availability of sufficient dayllghtlng. These wasteful habits revealed an 
alarmingly nigh increase in energy consumption. ^ * 



Although the health clinic operates 
week with other' cl inlcs in the city, 
The HVAC system is operated by a time 
week to accomodate sctedule- changes . 
building octupants, and the evaluation 
the day the clinic was closed. In 
fixtures in the bathrooms could 
fixture, and 7 or connected to a 
to show a savinigs, it is 



O&M efforts by building occupants. 



OR a schedule that varies f^rom week to 
a similar lack of O&M efforts vas seen., 
clock that could be reprogramned each 
However, re prog ramming is .not "done by 
team observed it operating all day on 
addition, high «wattage incandescent 
haye been reduc^, replaced with a flyorescent 
timer switch. Althoi^h the clinic did manage 
likely that the results could improve with Increased 
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CASE STU DY B; TOP LEVEL MANA6EMEMT THAT IS COyKEiWED 
WITH OBtAtWir^ EN^ftSY ^VlWIiS. Kit UgS DECggRALIZa 
MR !W>LI5N£kTAT10N. IWfceS A WtDE ftANfiE OF IgSDH^ 



Institution Type: 

Location: 
^ Latest ICP Phase: 
Savings: 

Program Information: 



J 



hns Inst 

f 



ailed: ' 



School (4 schools in a 
district) 

' k Rural county 

ECM . V 

* * 

0.2% (average of 4 schools) ' 

All* EAs 'completed by '12/79- 
y All E»te completed J)y 3/82 . 

« 

Total project co^ts: $108,994 
'(total of 4 schools) 

Storm windows 
Boiler controls 
HVAC cof\^rols ^ 
Lighting modification 
Window modification "i^, 
Energy m^agement computer 
. systems (2 schools only) 
Air conditioning retrofit 



r 

The school system's administra^ was cone ernerf wfth ways, to save energy 
dollars anj was reasonably well Informed on general technical methods. 
However, his management approach 1s to allow each principal to handle the task 
in his own way.. An added Incentive to principals was thatfthe dollars^^stfre^ 
through energy coftservation were returned to the schootl. 

The result was considerable daily awareness of energy results In one, school, 
but many procedural oversights and little Impact ,t»i energy in another. For 
example, the principal at one high school tSas very enthusiastic 'about saving 
energy- He reported, that he cpntlnually looked .for addltiortal O&Ms to the 
point that he receded complaints from parents that water coolers ^ad been 
turned off. The ECMs installed through ICP Irjcluded insulation In tellings 
and floors, air condiiioning retrofit , ^and window reductions. , The dollars 
returned to the sonool from the savings of the ECMs and active O&M efforts 
allowed the principal *o purchase and thstall window shades throi^hout the 
school . ' ^ ' 

At the'middle schogl^ln the , same dis'tr let. minimal 0&« efforts were observed, 
ani in fact, poor operation bf ECMs was seen^ The evaluation team observe 
overllghfing io mbctupie<$ -areas, where natural lighting would have sufficed , 
even if the area was occupied, Over-coolinp of classrooms , was evidenced by 
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doors open to the outside and . , students complaining of the cold. Further* it 
was diseove^ that air conditioning units had been installed in a manner that 
precluded easy access for maintenance, and thus, filter changes and regular 
maintenance on these units was rarely done. Data analysis indicated that this 
school had, in fact, increased its ertergy consumption by about 4X, whereas the 
high school discussed above achieved a savings of 25%. 

In summary, the school system administrator failed to^9na^yze adequately the 
total energy results by school, in ord^* to monitor^he practices, of each of- 
the school principals. Potential methods fo^ improving energy irtanagertient and- 
results were not shared among the schools. Total dojlar changes were reported 
to the principals, bMt no attempt was matfe to inform all the principals of the 
energy saving practices at the most successful schools. Consequently, savings 
varied dramatically by school.. 



CASE STUDY C: ENERGY SAVINGS OPPQRnWITIES MAY BE MISSED 
IF TA mims ARE Itot BUILDlJte SPECIFIC 

OR IF RESWJisittiLiYv m mmmesm lu m\ bELESATEo . 


Institution Type: 


. ' • ■»• 

11 schools (10 elementary, 
I high school) 


^ ' Location: 


Large urban area 


Size: 


" Snallest school is^ 10,536 
sq. ft. 


) 


- target schoo:? is 288,724 


Latest ICP PhaJe 
ComfJ^eted : 


' ECM 


Savings: * • 


'^-2%, (average of 11 schobls) 


Program Infonnartipn: 

) 

1 

* 


EAs, for all schools completed: 
12/79 

ECMs for all schools completed: 
3/81. ; 

Project cost: 

' » Smallest projec^: $6.460 " 
Largest project: $52,676 


_ EOls Installed: ^ 


Boiler controls * , • 
. » HVAC controls ^ ' - 
Vestibules 

Water fldt^ restrtc'tors 

» 



In this particular school district, 11 schools wfere select;pd for 'site visits. 
This case study illustrates two findings: to maximize eAe»:gy savings, 
building ^ecific ECM recommendations need to be developed... and responsifail Ity - 
for O&M authority is most appropriately delegated to maintenance personnel. . 

All TA reports and EP«I reconneuJations were iflade by a single engineering' firm^.- 
Although TA reports provided appropriate calculag^iohi-, it became evident that 
similar ECMs had been recomtnended for all the schdoTs. ' In this situation, it 
may be argued that specialization (emphasis oh ECMs w1^ which the analyst is 
most familiar) can produce better engineering analysis within- the given time 
and dollars allowed for •the TA. Oh >the other hand, this approach .tend«l to 
.foster non-creative and less cost-effective sqlutlons; The greatest harm, came' 
from SI apparent tendency of the analyst to ferce certain solMtlons uport all 
buildings. ' Although the sblut1or\ may not have. bieen* inappropriate, it may hot 



have been of the' highest^riority in terms of initially saving the most energy 
for the least^cost. The priority of a given ECM may easily differ among 
buildings, e^en though the buildings appear similar. Building utilization, 
maintenance conditions, and occupancy differences are only a few causes* for 
this. In this school district the results are amplified by recognizing that 
within a single district, building utilization and maintenance procedures do 
appear relatively consistent. 'However, data analysis revealed that energy 
savings varied widely anwig the* schools. Six of the 11 schools showed 
, increases in energy constroption, while 5 of the schools achieyed a savings. 
Overall, the district showed a 2X increase in consumption when corrected for 
weather variations. It is likely that savings may have increased if the TA 
analysts had evaluated which ECMs would benefit each institution the most. 

In''addition to having the analyst recormiend similar ECMs in each school, this 
district exemplifies the finding that centralized management of energy 
programs may reduce tt^ savings potential in individual schools. During 
building walkthroughs, it was learned that maintenance staff had been 
instructed not to concern themselves with energy systems in general, and the 
E6Ms in particular. 

A lack df ongoing O&M efforts was observed--for example,* domestic hot water 
heaters were 'set at maximun temperatures, filters were dirty, and Intake of 
outside air in vehtilation systems was unbalanced--even though the maintenance 
staff would have been capable of attending to the OiMs. In seme of the 
schools, the maintenance staff suggested' O&Ms that they thought they could 
undertake, if only they had the authority. Because of the lack of energy 
savings throughout the school district, there 1s no question that the schools 
would benefit from the delegation of O&W authority to the maintenance 
personnel . 
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CASE STUDY D: 


600D MANAGEMENT LEADERSHIP FOSTERS . 




^Ud^TANTtAl £N£KfiY SAVINGS 




inSLituviun ijjjc- ^ 


Hosoital 




Locatibn: 


Large urban area 




•Size: 


CI n CI I ft-^ 

510,613 Tt 

I build fng with several wings 




Latest ICP Phase 
Completed: 


EA in sample, but 
subsequently completed tCM 




Savings: 


■ 5% 




EUI: 
Base: 


606,311 BTU/ft^/yr 




Latest,: 


575,99^ 8TU/ft^/yr 




Program Information: 


EA,Com{^eted 8/79 



Although this institution was selected as afi EA site visit, it actually had 
received an ECM grant subsequent to the sample selection and prior to the 
visit. However, the energy results from the ECM did not occur until winter 
1982-83. 



There had been nunerous excellent O&Ms and energy conservation measures 
implanented at this institution over the past 5 years, by the current director 
of facilities. During this period energy consumption had been reduced 30% on 
a BTU/ft^ basis evien though new energy-using equipment had been added. 
Because of 'considerable energy use reduction prior to the EA of 8/79, the 
•reduction since then has been only 5%. The key to this- achievement is clearly 
^the strong energy-oriented leadership of the facilities director. Many 
comnon-sense procedures have been implemehted, good preventive maintenance's 
evident, a computer monitoring system is being used effecti-vely for daily 
assigranent of maintenance tasks, lighting levels h^ye been reducefl, 
temperatures have been optimized, and proper operation of boilers and chillers 
, is being tAserved to get maximun hardware efficiency. * , 

This facility has docuuented in excel^fent detail 1t& energy data from late 
1975 to the present apd has produced written anal ysiimf the trends. In spite 
of this unusual level of reconjkeeping , continuous building and energy system 
changes make it Impossible , to apportion credit for energy use reduction- to 
specific O&Ms or ECMs. ' ' - 
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The recently completed ECM (heat recovery chiller) is expected to decrease 
erjergy cons imp tiwi significantly durii^ its first wlhter season. In the 
future, this institution should provide interesting energy consumption 
results, as well as adequate data and system monitoring vnth which to analyze 
the improvements in the building's overall energy efficiency, since there is a 
high lev^l of 1 eadership ' and management interest in fostering energy 
conservation. 

♦ 
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CASE S TUDY Ei QUALITY T/KANALYSIS. APPROPRIATE ECM RECOWCWDATIONS, 

Atffi imm m trnm i^^yli a i\m imi or mmi savings 



Institution' Type: 

Location: 

Size: 

Latest KP^ Phase 
^ ^ Complete: 

EUI:"* ' 

Base; 

Latest: 

/ 

SaiVlngs: 

Program Informationt 
ECMs Installed: 



High school 

Large suburban area 

640,000 sq. ft. ' 



ECM 



201.153 BTU/ft'/yr 

134.154 BTU/ft^/yr 
361 

EA completed: 11/79 

ECMs completed: 12/81 

Total project cost: $379,437 

Boiler Interconnect system , 
Oxygen trim controls 
Steam trap replacement 
Pipe insulation 
Lighting modifications . 



,The evaluation team met with the school's facilities director and TA an^st*. 
Canplete energy records were provided, as was a written description of ICR 
experience, by progran phase. ' 

The facilities director reported that the EA was valuable to the^ school 
because it caused staff to look at operating systems and procedures from the 
perspective of energy consumption for the first time. In many instances, it 
. identified" cause-and-ef feet relationships that they had not recognized 
previously. ■ ' " 

The TA analyst , ws selected after * interviewing representatives from sevw-al 
/archUectural/ engineering fims.. The TA process was v1?^ as--^ing extremely 

usefol . Not onl^ did it establish thfe cost-effectiveness of eiTergy 

conservatioo options", but it also served as a source doc unent to determine 
. priorities ' and bud^s for work that could generate enough savings over a 

reasonable perjod of time to recover costs and effect real savings in energy 
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and operating costs. The criteria cited by both resjjoridents for seVecting 
those re'conroended ECMs for which ICP funding was sougfft included: (1) |»yback 
period, (2) practicality in relation to facility usage, and ^3) operational 
practicality. 

• 

The primary ECMs included a boiler interconnect system and installation of 
oxygen trim controls. The ECMs have allowed a complete change in the school's 
heating system by disconnecting the schooTs original boilers and operating 
smaller, more efficient boilers in the annex building. The projected cost 
savings for thB boiler interconnect and a variety of other ECMs was .$51, $00. 
The respondent, reported that within the first year of operation the' savings 
was over $35iTO0, since it became possible to eliminate one full-time boiler 
-roOT maintifhance position and another part-time position. Data an4^y?is ha^ 
shown that the k ho 0*1 has achieved a 36% savings since beginning its energy 
progran. ^ • 

By maintaining an ongoing successful relationship with a highly motivated TA 
analyst jnd maintenance staff, the school keeps up-to-date records of energy 
conservation.' A.t- the time of the site visit, the staff - vfls developing ' a 
concrete plan' for future conservation activities." ♦ 

* 
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CASE STUDY F: IWSUR IHfi THAT gCHs ARE FUNCTIONING PROPERLY 
AND Aw As6ft£$SlVE WSRAN OP QAWs SAvg tJmf 



IjMtatutlon Type: 

LocaWon* 

Si ze 



> 



V 



LdLfe^ ior.rfidae 

Gomple^d; 
EUI. ^ • 

* « 

* Base: " 

4.atest: ♦ • 

Savings: 

Progr^ Information 
/. 

ECMs Installed': 



SchoQl (elementany) ' 

Small rurei) tpwn* 

25,440 square^ feet"'- 1 building 

ECM ' ■' ' 

i 

139, 18& BTU/ft^/yr 

163.133 -BTU/ft^yr 

18.5% • , 

. EA, completed: a/79 
ECMs (ompleted: 6/80 
Total project cost: $5*523 

35-watt^'fluorescent trolbs 
i school wide , 

Energy Management Control 
System (EMCS) _ : 



/ 



This elementary school' was "se fee ted as one Df foiir schools- in the district 

that participated in the ICP. The primary respondent .for the site vi^it was 

the district^ S' superintendent, who has kept detailed records of ICP 

expenditures' and installation sojiedules as well as accurate energy consumption 

data. According to the 5uperifitendent. thS district ' hSs l^en involved ink 

. energy conservation since the .early 1970s, due to building renovatiqps and the. 

r.isjng costs of energy. At. the district level, an energy commltiee has betn 

formed to examine future energy con servatiwi potentials In the schools. ; 

♦ . * 

During the interview it ' was dtsc^ned th^t for^ 2 years, following ECM 
installatidn, the. schooV actually Increase- #ts' energy €<*stfnpt1on. It was 
also learned that the. cOrrpnt principal had been at the school for less th«n 
one* year, final data analysis showed th&t the , school had, ^ In' fact, begun 
saving energy after the .naw principal's arrival^ land. had saved 18%' since 
participating in the ICP., • ,. ' ' • * 

During the building walkthrough, the principal informed the evaluation team 
that' the EMCS controls ^» ad. been- set and he had assumed there wSs no need to 
change them. Hs had dfscovered', however, that energy systems were .cycling on 



[ 
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during vacation periods , 'and thfi^t air'cDnditioning was serto cycle on at 5:00 
a.m. ' The., principal,, therefore, learned the procedures for operating * the 
system and reset tii^jers to reflect acVtral schoo> schedules. 

The principal ' s .interest in energy con serv at icfn- was further evidenced when the 
evaluation team pointed out energy s'avihg O&Ms during the. building 
''walkthrough. Heating vents locat^ direc^tly inside the bui ]ding\ entrance v«re 
blastio^ hot 'air, which was desirable on. cool fal> morn»ings. buC unnecessary 
as outsi'dp temperatures rose, and classes were in session-. It was'^reconmiended 
by the evaluation team that these -vents be^'closed off • completely , even i)i 
winter, since school children entering- or* leaving the building would- be 
dressed warmly.' It was also suggested that an over Ijf empty all-puppose 
room/ cafeteria be mon ftp red to max incize * n^ituVal lighting and m-inimize 
' artificial lightipg. The school pr'ine'ipal showed enthusJasm for the various 
O&Ms" th4t it wo (I Id be possible for him to» cqntro^. 



Several inonths following the site visit, the principal voluntarily reported , to 
th^ evaluation team on the progress he had made. He had begun monitoring* -the 
school's Energy ,consLmpti(»i, 'al though hp had been unable to compare it with 
previous yiears at that tiifie. «H^.also reported th^t not only was he sure that 
clos^' off "the hallway heat vjents ' had reduceb consunption , but it. had been 
successful in curtailing loiteHng , in the haJliiSys. ^ In addition, his 
monitoring of lighting levels in the cafeteria had led to^inquiries into the 
ability to reduce lighting levets school-jftide. Fran the example of £his 
'institution, it may be seen that effective monitoring of O&hte and ECMs can 
Increase energy- say ings. ' ^ , ' * ^ \ J . , • • 
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. CASE STUPY S: CONSCIENTIOUS O&M EFFORTS PRODUCE SIGNIFICANT SAVINGS 

'Institution Type: ^ Local Government (Library) 


♦•Location: • 


r 

Small rural < town * 


Si ze: 


3;36%sq..ft. ' ' ' ' 


Latest ICP Phase 
Completed: 


EA V L ■ ' • 


• ^ 

EUI: . 
Base: 

^Latest: , 

V 

'Savings: 


1 

110,424 BTU/ft?/yr' 
84.667 BfU/ff^/yr 

23.3% * ^ 

• 


ProgVam. Information: * 


EA Completed 7/80 ^ - 



This facility uses only el-ectricity and' natural gas. It is 
Ves-idential building that v«s converted to serv^ as a library. 



a very 



old 



The EA suggested O&Ms of the conventional kind »uch as reduced lighting, /(. 
closer contrbT of temperature 'settings '(far both- occupied and unoccupied^ 
space), reduced hot water, and improved .maintenance for the heating equipnffent. 

Fuel .consumption data available in very ^complete form for several years 
di^;li^ed a 21% energy reductTfen ^rom the '77- '78 b^se period to the '81- '82 
period. ' . ' 

The respondent for this EA site visit, the librariaii, was impressive in her 
energy knowledge and persistence in maintaining O&Ms. During the walkthrough ^ 
portion pf the site visit, it< was clear that O&Ms were effective. Air 
conditioning and lights operated only in two occupied rooms. The- 1 ibrarian 
had reduced lighting levels in. all rooms, installed rviTiyl storm wirjdows, and 
turned off the hot water for tt« sumner, . ,<. 

Being a local government building, this institutidn'.wSs hot, eligible for ECM . 
funding.- In addition, - factors such as building age and. hou^ps of bcc*pa^ion 
woul6 drastically limit the. effectiveness of capital ^ppnditures for enfj^gy 
conservation. However, this library serves" as ^ spining example of the 



significant achievements tbat are possible witH the simple^ of O&Ms <i*ien. %py 
are -consistently pursu^ by ertthusiastic management-. ' : T e**^ 
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^CASE^TUDY H: SUBSTANTI/Il*€NER6X SAVINS^-MAr BE DUE TO THE CONCURRENT 


.tORf^CTllW OF POORLY MAINtAlNEO SYSTEMS MiEN ECMs ARE INSTALLED 




r Institution Type: 


/ 

rriVatc n lyn ^nuu i 


* 


LOCaQiOn . 


i 1 ;iy*no flr^HAn Arp^i' 




Si ze : ' ' 




t 


* latest ICP Phase 


f 




Completed: 


ECM * 




CI IT - 

EUI : , 






. . . Base: r-^ 


1M,991 BTU/ft'^/yr , 


* 


Latest r 


71,345 BTU/ft^/yr.' 




Savings: 


31.2% - * 




Program Information: 


EA Completed 3/79 


1 


TA Completed 6/80 






ECM Completeil 2/^1: 






Project cost: $62,245 




ECMs 'installed: 


. , Ceiling insulation 






. ' Boiler modif icationi^ 






/ Lightiqg modification 






y Window modification 




• 

— , 1, u 


Thermostat' controls 





In this high school t;he heating system had become so ineffective that students 
had to be sent home very cold days. The TA was performed independently and 
a credit subsejjuently received under ICP. This was a first experience in 
federal grant applica-tion procedures for the school management, and that was 
felt to-be the cause of failure to receive a hardship grant.' Watching .funds 
were obtained in a unique manner. Stock in the school (contributions) was 
•Nisold, bake salas were held, and a local foundatio.n m^e a major -gift. The 
managemeflt was very . plea^sed with' the^ ECM results 4K)th with respect- to comfort 
and to the major reduction of utility cost savings'. 

•The ECMs installed consUted of . 128 thermostatic control valves on individual 
radiators, a night setback til^e t^ck, ceiling insulation; a light-colored 
ceiling and 'sod inn vapor lighting for the gymnasium, fluorescent lighting 
throughout, and boiler dual fuel burner replacement with conversion from oil 
to gas. 

The energy consumption fran the base year. of '77-'78 to the 'post-ECM year of 
•81- '82 dropped 31%, aftap' correcting for weather var i'ations. .There were no 
apparent changes w-TTnrfr area, utilization, or pnergy-using hardware . during 
J the inter j»H>«ciD(f. 



This case suggests a factor that CQuld have explained part of the significant 
energy results. The #5 oil-fired boilers had apparently reached such a low 
.level cyf efficiency, possibly through neglect, that minimum heat condition^ 
for hunan occupancy cO\ild no. longer be maintained-. In tHfe process of "the, 
boiler burner conversion, general boiler cl^^anup and adjustment may have 
contributed a major portion of the subsequent . energy reduction. Since the 
burner conversion ECM was done on a seemingly inefficient heating system, 
there is nb way to now assess the division of credit Between thfi ECMs and 
O&Ms. However, even if good' preventive maintenance is not ,avai*l able in the' 
future, the change from oil to ^as- will prevent boiler efficiency from 
declining as ^rapidly as it may h^e in the past. " ,* 

Of the 31X overall ^energy reduction, consinfjitlon of fuel for heating fell 23% 
and electricity use fell.46X. Due to /the type of heating - system, almost no 
electricity 1s consuived in the heating, process. Thereforei the, 46% electrica-l 
reduction appears to have ^ome most! ^ #om the Ifghting changes. Of these 
changes;, the sodiun . vapor fixtures in the gymnasiOTi were 'fhrobably a major 
contributor, and were observed during ' the, site visit to provide a very 
attractive form of I'ighting. ' ^ 

In ^is institution, »ICP helped to reduce energy consumption. Although it was 
quiS evident that boiler replacement was imminent regardless of the 
availability of federal funtjjs, it is likely th.at an overall energy 
conservatltjn program would not- have occurred in the institution. TKerefbre^ 
even though the success of '^the^ boiler .ECM ac-tually may be due -to the* 
correction of a poorly 'maintained *sys tern, this^ institution' s ICP part icipf&t ion 
'also has brought valuable energy conservation knowledge to the institution's 
occupants, maiiagers, and maifttenanc^ personnel. " . 
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The following 5* case studies sumnarize the 
findings of the detailed fol^sw-up site yiisits. 
As may be seen frcm these . case . stiKlies , the 
lyturn site visits permitted* an in-depth analysis 
or the grantees complex energy systems and their 
overall building energy efficiency. 

These follow-up visits indicated that there were 
no previously overlooked installation or 
operation tliscf'epancies . Therefore, the amount 
,0f time aid the general techniques used at each 
of the original site visits appears to have btfen 
adequate to disclose the key find ings ^(Jev^l oped 
by this evaluation. Predi^e quantitative 
explanations for greater- than-expec ted po^t ECM, 
consunptlon did not 'result frcra- these return* 
visits.*' However, the individual case studies 
describe in a qualitative sense the most probable 
causes in each case, and t^ie circumstances v#iich 
j^preclude more precjse determinations. The 
addftion|l \site vis-it time also provided an 
opportunity 'to review tte energy data being used 
for the evaluation in more detail with the 
institutions. ' This resuHed In seme minor data 
changes, but the overall conclusion in each case 
essentially was unaffected. -v. 
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SE STUDY I: FOLL OW-UP SITE VISIT INDICATES THAT APPARENT INCREASES 
IN CONSUI^TION ARE DUE ftftlWftlLV TO SV.STEM HODIFtCATIONS AND 

A6D!TtoNs OF UNASSESSABLE AHou<>iTs mms mmm mfp^ni 



Institution Type: 

Location: 

Si ze: 

EUI w 
Ba se : 
Latest: 

Sav ings: 

Program Information: 



University 

Median size urban area 
92,670 square feet 



482.615 BTU/ft':/yr. 
540.675 BTU/ft^/yrj 



(-12%) . 

EA completed 9/79 
ECMs ^pleted 6/81 
'Tat*! project cost: 



$254,000 



ECMs Installed; 



Ventilation. exhaust air 
Heat recQv^y system 



This facility provides classroom anO laboratory space for the University's 
Chemistry ^i)^partment. The* energy needs of- this building" are especially 
impacted 6y the continyous air ventilation requirements -from the labora^ry 
areas through .a multitude o? vdnt hoods.' •Although the occupancy of the 
building H not continuous, hood ventilation. must be cpntinuoA^^o FOtect the 
ongoing 1 ^oratory experiments. - ^ 

Because of tf»e year-round ventilation requirement and limited opportunity to 
cycle-off , systems for energy conservation, selected ECM wa's an exha^ust air 
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heat recovery system. Ihis project, completed in mid 1981, replaced about 24 
roof top exhaust fans with two coUector duct systems and four large exhaust 
fans. Nine of the exhaust fans handling highly toxic laboratory* areas were 
excluded, from this systan.' * . . 

Tlie energy sources for thir building are tteam" prov ided by a campus central 
el'ectric generatir^ plant plus electricity. Ttie electricity'^'^consunption is 
i^tLTtt! at tho chcnistry buiMlng^but prior to the FC.m .installation the «;team 
'TiPtf%- for this building w^i? inoperative: Durinn mid 1981, the faulty steam 
meter v«s replaced, so accurate conptnption h|s- been available since the ECM 
was installed. CiiTculated ''best"' estiifljates t)f^team consumption were usgd for 
the pre- audit base year of 1978. \ ^ ' 

Qpmparison of the pre-abdit and post-ECH energy data* shows that stedm energy 
has been reduced but electrical energy has increased by a greater amount so 
that the net result has been an energy increase of 12X. In this facility, 
steani* converted to hot water for all heating of space plus domestic hot 
watHfT It is also the energy' source for air conditioning,, using steam 
^sorption chillers. Electricity is used for the fluorescent lighting and all 
water circularting pumps and air movement fans. A small electrically driven 
pimp was added is. part of the ECM exhaust heat recovery system to circulate 
the glycol/ water "heat transfer n^ediun between the exhaust air and outside air 
heat exchange coils.. . ' 

Although the on-site operating and^ maintenance personnel monitor the heat 
recovery system to be aware that its controls cycle it on approximately when 
the design conditions should dictate, there has been no measurement of the 
quantity of heat being recovered. Thermometer test fixtures' that v»ould permit 
measuring the amount of heat being recovered ✓were installed in the glycol 
circuit but they have not been used. The system is assimed to be recovering 
exhaust heat betause higher supply temperatures,- are rrow* avail able during very 
cold weather than used to be possible. This is a qualitative observation by 
o«-site personnel .in the ^sence of any (^antitativ« measurements. 

By reviewing electricity and steam consumption separately, it can be-se'en that 
the 4X)St-ECM steam consunption has decreased 20.7W but post-ECM electricity 
^use has ^increased 25.5%. The overall 12% total energy increase is due to the 
fact that about 5.7 times more electricity is used than steam. 

Although no exact Ve-EC« air flow data exists, it was' alleged that many of 
the original vent hood -air flow rates were less that the original design 
intentiOT necessary to meet health and. safety requirements. (Hiring^ the ECM 
project, these flow rates were increased by.speed»ing up the two' air' Handler 
supp.ly fans that introduce makeup air into the building.. The new exhaust, fans 
were then aijustml to produce the corresponding balance of internal "air 
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pressure arti flow. This certainly vould tend to increase ^he «ui^ding^s 
electrical consumption, but »^ether this. is -the major cause j^"^ post^ECM 
increase c^ nTt' rx,w* be^detemined. It Js also J^^^^ J^^^^^^^^^^ 

electrical laboratory equipment was transferred this building j^^^^ 
but there is no available docnientation^ to reveal tlje energy ; impact of tMS 
equipment. . , ' ' . » 

The, phincipal findings were: * • ' 

'\a This facility is now consimiing more • energy, after 
installation of an ECM projept^' that cost a total of 
$254 000. Because - of inadequate documentation. ^fv 
measffranent, testing and subsystem monitoring it* is not 
possible to ascertain the cause accurately.. There is » -a | 
possibility that the increase in air ventilation »*ates / 
incorporated during the time of the |CM installation plus 
laboratory equipment additions have increased energy us.e 
more than .the- heat recovery ECM has reduced, energy use. 
Whether thfe ECM is achieving its projected.. energy saving^, 
even thoughV out weighed by energy increases elsev^ere in the 
building, has not been determined. 

b A relatively inexpensive instrunentation effort could.be 
used'StO measure the heat being recovered. The high cost of 
this ECM would justify such instrumentation toyissure ttiat 
a reasonable payback is achieved. It /would aiso 
contribute, to conservation technology and thelUnversity^ 
valuable knowledge about whether projected savings can ber^ 
attained from heat recovery designs using certain hardware 
and concepts in actual bu-ilding environments. 
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CASE STUDY J: FOLLOW-UP SITE VISIT INDICATES TH AT INADE QUATE 
ENERGY MAwAfigtor At AM ALL a'feCTft)tC>AC!LlTY gN&ftfiY $AVIW6S 



I/istitution' Type: 
Location : 
Size: 
EUI 



Base : 
Latest: 



Savings: 



Program Information: 



ECMs Installed 



High School 
Small urban 
87,497 square feet 



/ 



213,944 BTU/ft/^/yr. 
^38,732 BTU/ft^/yr. ' 

(-11,6%) 

/ 

♦ 

EA completed 7/79 

ECM's tompleted^9/80 

Total project cost:* $4,000 



Sfwp door replacement 
Insulation of Raised eptis of^ 
roof 

installation of set point 
thermostats 



the tTifle of the first site* visit in October 1982, it was noted that many 



outside air dampers, improving weathfir stripping »id adjusting .doors for 
closing. . » • ' 

■ . ■ * I 



ERIC 
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Ubbn reviKting the school in March 1983 it was found that -no change had 
j1 . ^f^i-h^ nrouirtiiciv nhsprved .conditions. In fact , most of the 



occurrred irkany of^the previously observed..cftnditions. ^ . , ^ 

filters appea?ykto be dirtier than before. The coarse wipe mesh inlet screen 
over fe. central outside" air duct supplying fresh air to . several main air 
handlers was estimated tb be 60%-70% blocked by dirt accumulation Tins is 
readily accessible for cleaning with the use o^^.^^cu tin cleaner Also, 
several removable air handler filters ^were found badly restricted y^ith dirt 
accumulations . - ' • ' ^ 

"The 'data from 1978 through the latest periqij available (mid 1982), indicates 
that personnel efforts .had achieveif an 18% reduction in. energy consunption 
from the 77/78 to 79/80 school years.' However ,v since then, there Ms been a 
gradual increase resulting in current consunption of 11.6% above the 79/80 
base year. . ' „ • ' ' • 

This is the only all electric school in this district of 7 schools. The 
ranaining (five elementary and one junicr high) facilities havfe a mixture of 
gas and electric energy sources. During the school year period from 77/78 to 
79/80. the total energy consunption in 'the school district was reduced 
approiimaS\y 15% as cSipared to the 18% reduction in the ^1 electro high 
school . . ^ 

Following' are a nunber of factors that affect energy results in tb.is school: 

U 'The maintenance s'taff. consisting of only two persons for, . 
the seven schools, appears inadequate for good energy ^ ^ 
conservation result^ 




'Z.^Custodia^ personnel are assigned to individual principals 
art! are thus not available to the maintenance staff to 
obtain direct assistance on stjch matters as'^minor 
jSrev en tive maintenance or monitoring actions. Managanent 
.intends to change this, in the near /uture. 



3. The previous achievements in ^ergy reduction appear to 
have been largely 'the result of direct personal actions on 
a daily basis by the Chief of Maintenance. Due to the very 
small maintenance staff this personal cwmitment hasten 
difficult to sustain. The diminished focus, of natwnai 
attention on energy in -the past year also has contributed 
to aVlfessened conmitmejit by even •the most dedicated 
person's. 



* 
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4. For* various managanent and financial • realbns, this school 
• districted" not implement very many- ECM projects in the 
high school and thus ' the bulk of earlier energy saving^' 
w6re almost totally a function of O&H activities. The 
meager maintenance staff has- i)arely been .able to keep 
. abreast of rputine repairs and thus preventive maintenance 
and constructive energy saving actions have been very 
marginal. 



5. 



6. 



There is -no effective • energy program ,' emanating from the' 
Superintendent downward through the principals, teachers, 
custodians tnd other occupants ^ 



This school district 
high turnover of four 
of the ICP. 



has experienced disruptions from a 
superintendents since the beginning 



Defiled review of this high 
energy, and cost are^ possible 



school suggests that considerable savings in both 
with very limited hardware investment as follows: 



1. 



2. 



5. 



4. 



Two large air handling m its'* that run continuously to con- 
trol hunidity in a damp basement music room where musical 
instriments are stored could be shut off by inexpensive 
time clocks and a portable dehimidifier used instead. 



Central .time clocks 
panels to shut off 
air hand! ing » units 
continuously. 



could be installed at three electrical 
individual classroom and central hall 
that are now bein^ Allowed to ru) 



Several dozen incandescent fixtures in the high ceiling 
«entral hall area could be removed and only a few .fluores- 
cent fixtures Tnstalled to provide minimum required 
liQhting for jafety of 'personnel movanent. 



TJ>4 



gymnasium lighting and two large air handling inits^ 
could, be placed on .a time clock with a 1 Imi ted-time- 
increment override switch avail ^le for special uses of the 
area. ' . 




5. Tlie outside air dampers on all air handlehs could be reset 
fron their present fiill open settings' to proyid§ measurer^ 
m in imun quantities of ' fresh air. 



ERIC 
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6. Electrical demand rate changes and poss.ib1y some. energy 
cbos\jmption cddld be reduced tjy disabi ing. several. jtages in 

• , elWZf the';two ten-stage el^trlc boilers. Demartd savings - 
also could be achieved by adding an interlock qofitrol relay 
between the ddnestic hot water boilers and the ten-stage 
heating system boilers. Ibis wouW P^efl"?^- ji"'"^^"^^ 
oper^ati6n of both .the heating system and the domejtic hdt 

^ water boilers. . ' • * . ■> 

7. Further experimentation by oYi-site personnel on a' seaspnal - 
basis 'Should produce additional savings by gradual rettuc- 

^ tiohs in hot water^ temperature settings, restriction in- 
danestic water flow rates, farther" raluctions 'i^^ 
levels in all spaces and continuous occupant cooperation to 
"minimize the tot^J ' electrical load, particularly during th^ 
known peak load periods when demand charges are affected. 

The principal findings were: * ' 

a. The permanent benefits jfco this school t»vft beert^arginal as 
■ the result of part ici paction in the ICP. The major reason 
for this situation is that there has beai inadequate top 
management attention. ulevoted to energy and en^y-related 
" cost 'Savirfgs. 

- j>. -me school system' did not choose to invest the majority 
of energy improvements recomnended by the ICP program s 

fchnical analysis. ^ > ' 

e observed conditions indicate that management is not 
achieving a reasonable degree, of preventive maintenance, 
timely ehergy adjustments, and cooperative occupaht 
actions. NTte ratio of only two maintenance persons for 
seven schools appears inadequate. Approximations based on 
review of this schooT^s consumption over the past several 
years strongly suggest a combinati?^ of actions that might 
be instigated by' top man^ement to reduce the current 
ooerating costs by up 'to .25 - 30,0(K) dollars per year. 
" SSIt of these actions can be incorporated and sustained by 
art>ropriate personnel .with very low cost in materials, 
sl^h dollar savings in a single buildingp should warrant 
■ management's consideration of adding personhel as a net 
money saving move. E/4ntually. an appropriate a^lj^t jnf 
person could probably extend hls energy saving t^Pabi]1ties 
to the other schools -in the school district and. multiply 
his. dollar effectiveiess. 
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! CASE STUDY K: fOLLOW-UP JITE VISIT ANALYSIS INDICATES THAT A LACK 

N onrrcftxj^ m mmmmmm pmm an Asse^SMgNt sf ecm savings ■ 


* 

Institution Type: 

i 


Hos^al ' ' - a> 
hi ' ' 


Location: 

t 

. % * 

• 


Mediun size urban area| 

. . '"^ 


9 

Size: 


J- 57, 550- square feet 


m 




Base: 


571,399 QTU/ft^/yr. ' . , ' ' 


4*f««<<4«44<f< l.^tfiSt <<<.4r 


' 613,189 BTU/ft^/yr. 


* Savings: 


. (-7.3%)^ 


. Program' Information 

« 


EA completed 9/79 
■ * . ECMs completed 2/81. ^ 
^ ■ Total project cost: • $90^86g 


ECMs Installed: 

■ \ ' 

0 

* 


> 

Replacement of olaSs wall 

with insulated wall] , . 
. Heat piwps ' ^ V 
^Fluorescent replacement of 
incandescent lighting 



This facili^^was v,1sfted originally io June 1982. Using the data and facts 
available at that time it was determined that energy conscwption had increased 
by 22% since the, ECMs were completed in February 1981. 

The ECMs consisted of replacli^ an essentially all-glass outside wall in one 
wing ^ith insulated construction, plus in the same wing, conversion from mit 



3^66 

r 



110 



heaters to water-to-air heat pumps and' rep lacatent of incarKlescent - wfth 
fluonescent lighting. The calculated payback was more than 13-years. 

Followina tfie first visit to this facility the calculated^ energy performance 
wa bas^ r/o^Vison using the. base year (1978) that was cited 1" the tA 
oSh~ the re-visit . If was learned that certain events occurred ^ ^^^S that 
caused this to be an unstable reference vear. The latest 50% addition^ the 
hospftal cane into use in 1978 a«l theliitchei was , converted -fran gas to all 
'electric during the latter part of the year. ^ . ' ^ 

By selecting 1979 as a more appropr'i^te ^ Sim'^fri'^^g 

more favorable, but still showed. an increase of 7.3% ip total 

tb 1982. This! increase consisted of year-to-year percentages of 2.1. 4.0 and 

1.0. * ' . • • ' 

The TA had calculated a saving for- the recommended EdMs of 5% when compared 
Jith the con^Jnp^^^^^^^^ 1978. By recalculating these expectations, referenced 
to the 1979 year, the projected ECM savings became 4.4%. ^ 

Eneray used b5 the hospital consists of electricity, propane arxl seme diesel 
■ fuPl foV seVerar'aYeser ge^^^^ 

"ei^aJ ^imni^. T»« acc'uracy of data on Diesel fuel is ^--^^^^^^ 

i^co^i^.^^^r pficeTarft^T t^a^n^iils^of ^TngM^^ 

constit%tfs^ess than 2^ of\ne total ainuaKener^y so the inexactness of this 
fuel data is not critical. 

Wopane is used for heating domestic hot.Uter as well, a\ for. booster heat for 
Thriaundry hot wat^. Propane also is used as ^a ^ackuP 
water space heating system. Since the Fimary space heating boiler is- elec- 
'??ically operated %nd frequently switcr^. off fc) reduce e^^trical danand 
changes, the prbpane boiler .often becomef the primary source .dunng the peak 
heating season. 

ft^-evaluation of the installation and operation of ' t«e ECMs did not disclose 
^y spi^lic erro^ or anissions that could explain the. increase in en^^^^^ 
roJsumptioV since the ECMs were comj^leted I" ^arly 1%1. Ho»«^, sever^j 
factors we^e discovered that appetr to^explain most- of the increase. For 
example the "Patient Days" have increased 6.8%. fr«i 23.587 in 1979 to 25,189 
1^982. Inployees havrincreased 13.4% and three departments ^^^ve gone to 24 
tour oD^ration (from 8 hours in two cases and from 16 hours in the other). 
Mdit?o^al energy consuning equipment has ,beai steadily added throi^tout t e 
m and 1^2 period since tSie ECMs^were* f^ished. .Seven additional heat 
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punqs for a total^ of about 18 tons of cooling were included in this, plus a 
rooftop unit usiQ*g both heating water- and chilled water from the central 
system. Although no records were available to identify the consunption of 
other energy using ec|uipmait that has been added, it wa's found that numerous 
items such as- an 18 Kw drying cabinet, la/^e freezers, nucfear medicine 
cabinets. X-ray tablps, ccaiers, vending ma^chines, ice machines and medicine 
refrigeration and warm ing^abi nets had. been acqi^ired. Apparently, recent 
procedurjBS have been implemented to acquire better contro,! and docunentation 
of future energy qpnsunlng^quipment as it is brought into tlie hospital . 

The present Director af Maintenance for the hospital, had held his, position . 
f^r about six months at tfw time of the. return visit. There* have, been three 
people in this position plus two hospital ^administrators throughout .the IQP - 
participation. ' The present Adninistrator hacT been there aboi# six weeks at 
the time of the return visit. • ^ , \ 

The present Maintenance Director is working ' hiarJ lu .eJuLti electrical cost^. by 
limiting electrical demand changes. A demand^ controller-, purchased in 1978, - 
has b§en connected to additional control points and the diesel generators are 
operated several hours i day to-hold the peak deman^ within close I'lmits. 

. ■' / 

Although; time did'' not permit a detailed investigation, it appears possible 
ttfat son^ of the high energy use may be due to the fenlowirtg situation: 

• >/- ^ 

The basic HVAC system consists of^three> watgr loops. -Many v«ter to ^ir heat 
pumps are on ,t comnwi water heat source loop ucirg corllng^ tower v/ater. 
Another loop contains chilled water from a ceatral chiller for air handler 
efooling coiljr and a thind water loop provides hot- water to the same air 
handlers frdm the central hot water boiler. There are no afr handlers* with 
100% outside air available through an economizer cycle . control 1 er , so 
virtually all interior cooling in the winter most be provided mechanically. 
The result is that heat ,ts rejected- from the cooling towef " all winter except 
for portions of about a month and a half. On the day of the revisit, the " 
outside air temperature had only risen to 54 by 2:30 W from the low 40' s in 
the morning a^d yg| the coolings tovrer vanes- were, constantly open with" water 
circulating at 84" During the lata mo/ning "witti the kitchen cooling load, 
the cool ing tower fans periodically cycJ«i to limit water- temperature. 

This may indicate that even on days cool enough to prbvitffe "free cdoling" with 
full outside , air , the building is instead being cooled mechanically and the 
system is -producing .a ne^t. hot water source greater than <he water to air heat ^ 
pump loads can -util'tze. ' ^ ^ 



It is likely that the total energy load could be sipif icantly reduced in 
Hinter (where the peatf now exists) if 1(XJ% outside a1r economizer cycles were 
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fncorporated , and the ?e3ection heat from. tTe cool ing tower was el 
The pr loci pal findings were: . * 

a. A* cons^erable .quantity or energy-us>ing equipment 
V apparently has been continuously added' to thi^. facility 
durirtg the Several year period from P^'^f'^^Vj? PJf^"™ 
comp'letlOT. The lack of exact infonnaliwi with which to 
measure'this growth in energy use snakes it impojsible^. 
* assess the ECM. perform ance solely on the ^^^J^ of^^°^^^ 
pnprav consumed by the building. However, without special . 
Sing ari? insto-iin^ H is impossible ta measure 

the effect of tne €CMs separately. 

b/'A relatively high turnover, in^the, ho'spitaVs top management 
in recent years Appears to have been a handicap Tn 
Achieving optimum energy benefits through effectiv^ 
operation^ and maintenance attions, ^^t\m}y Prevf.tive 
maintenance. There are very positive indications that this 
is now improving.* ^ * 

t • 

c Tlie installed' ECMs had small projected ' savings of about 
y. . c. Jf^^ ^"^^ g t^e^g appear to be existing jystem 
deficiencies 'that, cbuld te correcte^l with cost, effective 
ECM's that would increase the savings realized. 
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CASE STUDY U FOLLOW- UP SITE VISIT OBSERVATIONS SHOW THAT EWW Y- 
ftgftFtiftHMCigJf g CMS WITH LOW ftkigm $Av^M6S CAN NOT fe^ 



CONFIRff&^WnH OWLV BUILDI NG COHSUHP TI ON PA I A mm T HAN 



Institution Type: 
Location: 
Size: 
EUI ~^ 

it 

Base: ^ 
Latest: 



Hospital 

>teditin size urtwn area 
114^000 square feet 

490.488 BTU/ft^/yr. 
528,488 BTU/ft^/yr. 



Program Information: 



,ECMs Ipstalled: 



EA completed 8/79 ^ 

ECMs completed 9/8W • 

Total project cost: $234,000 

OilVto ga5 conversion - 
Chiller heat recovery 



The Technical Analyst for this facility had recomnended six ECM projects 
calculated to have a combined payback of 5.6 years, produce m energy reduc- 
tion of 2^ and cost approximately $457,000. 

Only two of these recommended ECM projects wer« installed at a project cost of 
?55!l^ $234,000. The TA had projected an energy reduction of 4X for these two 
ECMs. Thfeir expected individi/al paybacks w«re 2.5 and 10.7 years. A higher 
than projected project cost resulted from installing a si ightly' larder )ieat 
recovfry chiller than originally planned, in order, to allow for some future 
expansion. 

Comparison of the po5t-ECM energy consumption with the pre-ICP period, on a 
weather corrected basis, shows ad increase of 2-5X in total annual BTU use. 
This includes cdrreetion for a floor area addition of 3.23k that occurred 
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' i.v^ i^Lr^^ Aaun certa id energy tonsiming equipment was added 

Ksk^s avl'fable. Duri,^ the s»-e i.t^w period, the average annual 
patient load also tficreasejJ by 22X. 

nn otP review of the installed ECMs during the foloH-up visit did not 
d 'se installation or'operatic. problans^hat, could "using the less 
than oroiected savings. One ECM consisted of conversion ^om to gasjjse 
brtv« sCV'e"' There is .no condensate return.of a^y of this s^eam 1 
the hospital ^ the TA did not address this as a possible ECM. '"^ .f^spuai 
.staff TwevJ. has irxlicated an interest in .^Icing this improvement 'during 
future en.ergy projects. . . ^ 

flbat recover) 



mit for done Stic hot water preheating. This .project is not instrunentea m 
a^y tnanner^tSat vcufd perm it 'savings to be assessed .^^^^^^^ I'L^r^loaS^ 
oplrat^ througtout tJ« day during much of the year due ^ total cool ing oad 

ctac^tr^a^ muria^Vril i^fe T^l^a^^T^ t1ira%^eJlilry 
uni musl L^^^^^ percentage load c>n the bagger 

ch 1^ unless tte weather becanes much wamer on such ^ays , tl^ smaT^^ 
heltTe overy unit cannpt be added back to. the ^ystem^"til 
AHAin fonseauentlv the annual percentage operation, and thus, tne savings 
'f \h^.'?parr^^ov^v chiller ECM may be considerably less than the 
a sii^. Th^ liroT^nftrline^^ reconls of operating-ho.urs makes^ 

impossible to assess this ECM's performance accurately. 

'I^he principal findings were: , . ^ 

^ TVa T& Arniprtions of aierav savings 'for these ECMs was 

' rp'prcSfmte ' Tte TeasS^ed pos?-ECM ene^, «ata s^ws 
' " an overallSospital increase in consumption -of 2.5%, rather . 
than a savings. However, both energy c on sun ir^ L^fJjT^^^ ' * 
and mission fequiremeffts have increased but the effect on , 
• * consinption c»i not be qiiantified. '^The net result is that 

both 5ie actual and the expected results are m a very 
sSall percentage bind and a precise evaluati^i is extremely 
' difficult. 

b. It appears .that the ECMs were installed properly, blit w^^ 
too minor •in contribution to show up in .total energy 
consumption measurements. Separate instrunentation would 
be nwiess^y to identify the savings generated by thfese 
ECMs. ^ * * * 
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CASE STUDY .M: FOLimHIP SITE VIS IT OB SERVATIONS SHOWTHE 
/ ABSENCE OF A DliUUAil: lA DOCUftNiAllUN. ADDI T IONS OP EWER6Y , 
^ ' CONSUHINS EQ UlPfeNl. AND" A UCFoi- HONllU«iN« W HE I EKIWfi AI L 



Institution Typ^: 



Location: 



Si ze: 



EUI 



Base*: 
Latest: 



Savings: 



Program InformationV 



|CMs Installed: 



Hospital 



Mediurti size urban area 



211,192 square -feet 



444,244 BTU/ff'/yr, 

m 

414,980 BTU/ft^/yr. 



6.6% 



EAvccmpleted 10/79 

EGMs completed 1/82 

Ideal project cost: $170,775 

Heat recovery from boiler 
Chiller controls 
Air handler return air ducts 
and controls -on several units 
Replacement of incandescent 
lighting with fluorescent 



This facility ms originatly visited in December 1982. The ECMs had been 
completed in January 1982, and thi^ji^ there was less then a year of available 
post-ECM energy consunption data. 



V 



• lie 



The installedrECMs consisted of nine distinct projects that may be categorized j 
into four te^:hnical 'groups: (1) .heat recovery for boiler makeup: water was 
"added to both the boil-er stack ^and the boiler bloiidown; 12) controls were 
added to «u electrically .driven' 350 tftn/ centrifugal chiller';* -(37 nunerous 
incandescent fixtures were replaced wit± fVyorescent or sodium vapof lighting; 
and (4) five projects involved adding return air ducts and additional controls 
for several air handling units. ^ ^. » . ^ . 

In the TA, dollar costs dollar savings, and payback years were' calculated for 

all of the rfetomnended projects, projected BTU savings were listed for 

only 5 projects. For the»e five, the total expectation was at least a IQ% 
'Savings ,in annual BTU consumption. ' ' , 

On-site inspection of the ECM projects' *ind icates th^ ail were correctly 
installed and there Is no obv io us mal functioning. However, several conditions 
of the design make it difficult to establish the amount of energy savings Of 
most of the ECMs. For ex^ple, a complete lack pf temperature and flow 
indicators in any of the ECM heat recovery circuits has made -it impossible to 
establish the amount of boiler waste heat being recovered. The chiller^ 
controller ECM functions properly, but during certain weather conditions the 
resulting higher chiller supply temperature makes It necessary to augnent the 
controlled, chiller with a smaller, less efficient chiller in order to provide 
the necessary tower temperatures in one remote zone. The energy consumption 
of this cbmbination of a more efficiently controlled large chiller- Q(l us a 
lower efficiency small unit may not be any less during these weather periods 
than the previously existing large chiller alone (before it received . the 
qoaitrols tp tailor^its output). 

The fuelSi&ed ^-e electricity and natural gas. Analysis of**the consumption 
history using the pre-EA period of calendar year p79 versus the post-ECM 
calendar year 1982 indicates an energy saving of 6.6%.' ^ter correcting for 
weather differences the result is a 5.6% increase in conVpptiorf. The base 
year (1979) had 13X more severe weather. 

During the period since 1^979, there has been a contiQ^ial >afddition of energy 
consuming equipment in this hospital similar to that generally .observed in 
most hospitals. . Although a listing ff some of the added equipment is 
available, there is no acceptably accurate way to estimate the energy impact 
*of this equipment growth. The duration of use, location, impact on heating 
and cooling loMls, etc. of this sdded equipment has not been docimented. With 
energy conswnption analysis based only on knowledge of total facility 
consumption there is no accurate way to identify the amount of ECM savings. 
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In general, this hospital has probably dc h lev e4 more ^success than most in 
avoiding energy increases. Hie condition of . ttie' equipment reflects an above 
average preventive maintenance program, "the technical knowledge and 
management skills of the facilities director are wel/ above average and many 

tak&\ both before and sfnce ICP ffarticipation to eliminate 
For example, lighting energy consbmpjjion has been 



actions have been 
un^needed enej^gy use. 
significantly reduced 



CcMnparisoh of, the energy use index tnd patient cos£V factors of this hospital 
with several others ^in the adjacent geograpt^ical arid clearly indicate^ that 
this hospital Is a leader in its vicinity. 



The principal findir^s^^re: * , 

a. The BTU savings lo be expected from some of the install 
ECMs were not identified in the TA. 



b. TTi^ energy -savings -of the completed £CM projects cannot be 
directly assessed due to the lack of instrunentation. 

c. The normal growth of energy consuming eqw.i.PBjeftt ,-Ance the 
base-year may rww be causing more energy consumpp^n than 
the ECM projects are saving. As with most complex 'facil i- 
ties, very little credible analysis of how emertgy savings 
are baing offset by these additions is possible without 
records to track performance. 



d. 



fhe observed capabilities and regular actions^of the facil- 
ities stetff are above average and cannot be faulted as' the 
cause of low overall energy saving results. 
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APPENDIX A - THE ICP: BACKGROUND ON THE ICP AND ITS EVALUATION 
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PROGRAH'fUNOING 

location of Funds to States \ 

The Oe^iartment of Ener0y._4aOE), under *a formula specified by rule, is 
respon/i!)le for allocatflno ICP funds to States. >The federal government 
matches State administrative costs *^sociated with imp! em'en ting t})e program 
through SEOS, as well* as Vo^ides the grant monies for the TA oV ECM phases. 
Fifty-percent matching funds were allocated to States for conducting PEAs and 
EAs on the basis of a three- part funding- formula that included: an' equal per- 
State share, a share based on population', and ^-climate factor. An additional 
factor— fuel availability and cost— is used in the formula to allocate TA/ECM 
funds. Both insti tut tons' and States* matchin|L funds must, in all cases, be 
fran non-Federal sources. Table A.l describ^-the resources committed by the 
10 sampled St^ates as matching^ funds. . " v 

Anocatloq of Funds Wlthln^States 

Individual '^SEO* chose the means by wivich they vould subsidize the costs of 
performing energy audits at eligible institutions. Some chose ^ Vain 
institutional personnel assigned for this purposfe, others sent State employees 
or contractors |to perform audits, at nonprofit facilities, and a few reimbursed 
institutions for the charges levied by independent energy auditors vlio had 
been trained or certified by the State, 
f 

TA and ECM grants, on the other hand, ar^ awarded on a competitive basis. A 
minimun of 30% of funds available for TAs and ECMs were required to go to 
schools and at least 30% were required to go to hospitals in each grant cycle. 
Thus, neither schools nor hospitals were permitted to receive more than 70% of 
the comb*ined TA/ECM allocation in each, State. Th6 background and financial 
data on the 10 sampled States' allocation of funds are presented in Table A. 2. 

Grant Award Procedures 

SEOs were required to produce DOE -approved State Plans describing funding 
formu^e^ a'nd adninistrative. methods before entering the .ICP.^ These State 
plans are updated "annually, y \ 

Tor PEAs and EAs, t^ie States applied to DOE directly for furyding on behalf of 
themselves and participating institutions, operated the Progtam, and submitted 
Vog^ess and evaluation reports to DOE periodically. Becaftse DOE wished to 
allow the States a great deal of flexibility In adttiinistering the Progran, 
procedures for conducting PEAs »id EAs varied widely from State to State 
(although thes^ procedures were reviewed by DOE officials In the process of 
^poroving each State Plan). SEOs were allowed to apply up to 25% of the funds 
allocated to them toward administration, monitoring, and evaluation 
activities. • * # • 
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TABLE A.l. RESOURCES- COIWITTED' BY THE 10 SAMPLED 
STATES^S MATCHI^^ FUNDS . 



IN ADDlTIOy^b^ 



TYPE KAtCWiNG SOURCES 



$ OR OTHER RESOURCEl IN ADDITIOHaPfD^fWTCH 



FtOftlDA 



- All 'CASH MATCH ^ 



— peas at ns cost by facilities pubuic broadcasting 
System 

— training facilities provided at ngt charge 

— Sources of Regional Planning Centers 

— ta assistance by florida souut center 
niscell^eous assistance from seo 



Illinois 


— EA; All MATCH HAS IN-KIND 




:tlf4N£S0TA 


r 

^ 1 1 


— $10 MILLION STATE AFFROPR 1 AT ICW TO SUPPLEMENT ICP ^ 

* 

ItePARTf^NT OF EDUCATION/ Regional Develop^nt 

ComissioNS/ League of Cities assistajiice ^ . 

*<- 


MISSOURI 
f 


N/A • I 


N/A ' . ■ ' 

1 c: ^ 



i^XICD 



All cash match 



— $65/9m donated as administrative time^^ 

— Staff time and travec to training courses 

— VreI' PUBLICITY BY EES OFFICE AND INSTITUTIONAL 
GROUPS^. 



NEW York 



STATE Education and fftALTH 
Departments pik^vided 

— PTOF€SSI(»UL VfAFF FRW OTHER 

agencies ' 

Energy Conservation Hotline 



■ ' ' ^'y* 

OKLAHOMA 


— All in-kind 


. — . ■ 


Ri^DE Island* 


- H/A 






Utah 


^-«/A 




— Stats has cohtributed mwey beyond that reouireiJ 

BY rooSRAM 


VIRGINIA 


y ~ Cycle 1 1 
— Cycle 11$ 


75% IN-KINO MATCH 

AU CASH NATCH 






N/A - NOT AVAILABLE AT T^^ OF $E0 INTERVIEH 



\ 
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TABLE A. 2 BACKGROUND Af^D FINANCIAL* d'aTA ON 
10 SAMPLED STATES' ALLOCATION OF ICR FUNDS* 



FL If -m no* m m* ok' 



tMEN HAS State Audit Program . 

ESTABLISHED? * ^/79. 6/79 5/79 

Total cost to date in ADMimSTERiNG 

EA PKAS£ OF ICP.C$) v »6;6,6W $5^41 $322,395 



S Federal FuHDiNa MATCHEifsy * ^ ' • 

STATE F0« £A PHASE OF ICP ID iOOX ' lOOX ^ iOM 

/ 

I Federal puhds allocated to State ; i 

FOR EAS THAT «A$VUSE0 CX> 39. « ^ lOOZ 51. 5X 



2 EA'Federal funds expended to 
oate for administrative purposes 



J 



100% 29% 93 J% 



Z Federal fuwds passed through ^ 

TO DATE TO PAY COSTS OF EAs THEM- 
SELVES (X) 



39.11 . 71% 31. 5X 

1 

Total cost to date ih ApHi mistering 

TA/ECH PHASE OF ICP (15 ' $557,785 $707,013 1139.73^1 
X FEDERAU funds MATCHED BY STATE 

FOR TA/EC1 PHASE (X) lOOX ♦ im lOOX 
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Amount of TA/EC:i funds expfjideo 

to'date for; , i , 

A. state staff ($) $537,783 $4^11,959 $ 

B. TRAINING ($) -0- ' $ 75,000 . $ 6,987 ♦ 

C. PROGRArt REVIEW AND EVALUA- 

Average * State staff assigned to , „^ ^ . 

ICP • -3 4.5 21^ 5 3 25 2 

♦ 

Average # of contract personn|l . ' 

(IF KNOWN) 18 SOME 

^ .,,.1 , — ' r— ■ 

•^13 State funded and 8 FEDERAL funded. ^ 

• DATA*NOr AVAILABLE AT Tlf« OF SEO INTERVIEW. 




The TA/ECM funding process begins With DOEs allxication of fu,nds on a 
State-by -State basis. . SEOs then solicit, evaluate, and rank aopl i cat Ions from 
institutions. Recommendations for funding' are then sent for review^to pOE 
Regional offices.' Approved appl ications .could be awarded a grant for 50% of 
the cost* of ''the proposed project. The other 50%. h^d to. -be paid by the 
insti'tytion, except in hardship cases (see below). , Each State is responsible 
. for grant administration and for mo/iitbring impteiuentation of funded 
^;--afrtiy.ities: SEOs are allowed to applf for up to 5%. of the total TA and ECM 
/ funds awarded in each funding •'cycle fqj>adwinistrative expenses. 
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Hardship Funds ' ^ ' 

Ten percent of available funds are resejfved for "hardship grants" to finan- 
cially distressed institutions. Each (State is responsible for developing, its 
own formula for disbursement of hardship funds {which is indluded in the State j 
Plan), and far. identifytng those Institutipns eligible to receive incranental 
funding above the 50% matching retpjirements . States must develop procedures 
for determining what increment (1-40%) of additional funding will be given to 
'institutions qualifying for hardship funds. These procedures are included in 
the State Plans. ' ' 

PROGRAM IMPLEMENTATION: A CAPSULE HISTORY j ^ . 

Figure A.l displays the regulatory history of the ICP and some of the 

milestones achie^. * ' 

« < 

OPERATIONAL RESPONSIBILITIES PROGRAM PARTICIPANTS 

> ., * . 

The ICP allows a great deal -of flexibility in the local management of Program 
activities- As a result, it also requires significant labor and resource 
comnitments by participating parties to complete necessary paperwork anij carry 
out administrative functions. The »*eas of responsibility .for the four 
parties - institutions. State energy offices, DOE Regional offices and DOE 
Headquarters ai;e delineated below. 

Institutions V,^ 

The institutions participating in the ICP are responsible for the following 
activities: . t 

• Securing matching funds . 

• Preparing formal applications for the TA and ECM stages of ^ 
the program. 

t Reporting on expenditures and energy consumption for up to 3 



years after grant closing. 
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FIGURE A.l THE ICP: A CAPSULE HISTORY BY YEAR 



mi-- 



Althoush HECPh^Hcmiiss fiwoins for 1978^ the lifcr oio not 

BECO^ EFFECT ITC IWTIL TWE FIFTH »«EK OF FY 1979. 

Final rules for Phase ! (PCA/EA) published. 

Final rule initiates Phase I (PEA/EA) of Cycu I. - . 

Final rules f»t^Lis»€D for Phase I I (TA/ECJ1) .of Cycle I 

INCU10IN6 REQUIREMENTS F(M STATE PLAN. 

Final rule initiates" Cycle. I of TA/ECH Srants. 

Of na $20 million availabu for schools and hospitals^ 

$18 mVlION (90t} kM9 fiMMXXJa. 

Of T>ffi 17.5 NIU.I0N AV/IILABLE FOR UKM. SOVERMffiNT Al» PUBLIC 

CARE INSTITUTIONS. $6.4$ ttlLLfON (^X) WAS MIAROEO. 

ftoST OF THE STATt^ PREPARED AND SUBhItTED STATE PLANS BY 12/31/79. 

NO TA OR ECn CiHANTS OF ANY KIND MERE COMPLETED BY THE STATES 

IN 1979. • - . 

m 

M« APPROVED STATE PLANS FOR. H OF T>€ 55 ELISIBLE JURISDICTIONS 

$112 MiaiON AHARMO TO SCHOOLS AND WSPITALS AND- $5.3 MILLION 

TO LOCAL SOVERN»«NT AlfD PlffiL||e, CA8E INSTITUTIWIS FOR'.TAS AND EC«S. 

Cycle. II OF KA/EA BEGINS. ' . , 

Cycle H of TA/Eaf ,«b«(t<besims,. " , ' 

$11 million were AHAiH)Eb ^ PEA/EA BY 6/2^. 

$109 million were /«<ASIDED TO IN8TJTUTJ0NS IN 5*1 JlWlSOiqTICWS 

FOR- TA/ECM BY -9/30/80. 

Program to upgrade ruus and resulatioms initiated at £»£. 



CVCli in OF TA/ECfi grants BECINS 
reA/EA MOTt FWDEO ®^ ^ ^f* CYCirfHlI. 
UPGRADING OF REGULAT tONS COWLETED, PROPOSED/ AND MADE FINAL, BY 

5/81, Changes iNbLUDSlh. * 



k/2/79 (TO END 9/50/79/ 
U/17/79 

aajm <To end 2/1/80) 



J^7/79^< 



<«/l/30 (TO END 5/30/8i)> 
6/2/80 (TO tMD 9/30/80) 



a/S)/81 (TO END 9/25/81) 



1382: 
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" Cost savings now calcuuteo as net difference in fuel costs 

, FOR COAL conversion. RATtflW rUAH AS RESULT WILY ol ENERGY 
SAVINGS; ' 

— Greater flexibility and EFFiciEfwrY State's allocation of 

GRANT FUNDS.* * 
$159 Mll^iON AMARI^ in all FOUft CATEG(mi£S FOR TA/ECH DURING 

Cycle III- ^ . * 

Final rule permits DOE to use the wst ciwrent wta elements in 
THE all<»:ation F<mm}CAE. 

Cycu 4 V FOR TA/ECa grants BEGINS. , 
PEA/EA, NOT FIWOED BY Q(£ ^ItXYCLE IV. 

$147.4 JlJrLlON AWARDED IN ALL FOl* CATEGORIES FOR TA/ECM DURING 
CYCLE IV. ^ ' - ' • 



CYCU V FOR TA/ECfi GRANTS BESIN8. 
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<»/13/82 
1/13/82 (TO END 3/31/82) 



6/1/83 (TO END 8/33/33) 



r 



• Administering competitive b1d(Hng for ECM contrac^^s and 
, overseeing construction processes . \ ' 

• C(»»plying with iavis-Bacon Act and EEO Standards , inc>lud1ng 
> recordkeeping, reporting, and contract monitoring. 



* • Performing ICR "prerequisite" (or comparable activity) 
before proceeding to next^'Prpgram pftase . 15 EFe case of 
independent' audits performed outside the- ICP, institutions 
must assure that they comply with Program requirements . - 

. . I ■ 

State Energy Offices 

As a result o^the ICP, SOs h&ve taken a major" role in identifying, and 
•addressing institutional energy conservation needs. Duties assumed by SEOs 

include:* ' * - ^ ' 



t Developing and ievising State 'Plans as needed to meet 
• Rrpgram requirements . ^ 



' Securing State md'tching funds . '* 

• Pe^^oi^inq day-to-day ^ants management and troubleshooting , 
providing a link between DOE and the Institutions for trans- ^ 
fa* of information. 

• Publicizing ICP activities . • ^ . 

• Reviewing and ranking all TA/ECM applj cat ions , focusing 
technical personnel and adninisxrative resources on the 
review during application periods. 

t Providing fundraising assistance to institutions for mate h- 
h ln^ funds (as needed}. • ^ 

• Monitoring TA/jCM implementation . 

DOE RegipnaV Of /ices ^ ^ 'j' 

Regional personnel serve as supenrisors 0f Program progress: they facilitate 
cofimunication between DOE and^the SEOs and^ between different SEOs^, oversee 
Program 'expenditures,- |nd provide technical md administrative assistance. 
Specific responsibilities inclu«l$: ' ' * / 

• Rev iewi no/ applications after they are processed by the. SEOs . 

• IsstTtng Notices of Grant Award for each frant cycle. 
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/ • Recefving reports fr«n State Energy Offices . 

• Processing payment requests and coordinating fifaTtti^l 

• disburseffltfits with DOE Headquarters. 

• Monitoring grant performance. 

DOE Headquarters ^ * . " , 

Headquarters personnel are responsible for the following activities: * 

• Developfhg and revising Program regulations . 

• Reviewing and approving State Plans And revisions to State 

1 Plans. '• ^ '. * 

• Allocating funds to States for PEAs/EAs, and overall finan- 
cial managoient. » 

• Periodically reviewing Program progress . ^ 
Performing and documenting evaluation activities . 

* - 

Communi gating and coord fnating with SEO% and Regional 
offices; scheduling grant cycles and regulatory changes. 

• Coordinating public cgmiunicatlon efforts for the ICP on a 
' national l^el (through reports^ responses to inquiries, 

etc.), including relations with tongress a«d with national 
-healtn and schaol assoclatfons. 

The sequence of activities required for gra^ approval in various phases is 
, shown in T^e A. 3. As can be seen, DOE deWgatad to the .States a gi^eat deal 
of controller the program. ' 

# 

VARIATIONS VITHIN THE P(«}fiRAN ^jUl? 

The decision to run the ICP at the State ^IT allowed the States to c.ustom 
tailor the Progrm^o their individual nads,. However, the flexible nature of 
the Program, coi^Jed with the great variety of circwistances between States, 
gave rise to variations and'inconslstenclK in implaaentation. The fact that 
some aspects (e.g., auditor training and tA reporting requirements) were open 
to Interpretation comp ou n d ed Program variation. 

Furthermore, the States, in ranking ECM applications, were given a list of 
cr1t«*ia to apply, but were given fre^om to.isisslgn their own weights to each. 
Thus, suqh Items as simple pa^ack. types of energy conversions (e.g.« oil to< 
coal), types arti amounts of energy saved, and local climate were brought to 
bear in diffierent combinations In each State. 

^ ... 
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PHASE 



PEA/EA 



TABLE -1^,3 SEQUENCE OF GRANT APPROVAL ACTIVITIES 

PROCEDURE- * • DOCUMENT GENERATED 
j ■ * — • 

1. APPLIES TO ME POrf PEA/Gi FUNDING. APPLICATION 

2. !K)E APPROVJSS APPLICATION AND ALLOCATES FUNDS . 

* 3. Institutions complete PEA » ^ 

FORMS AND SUBMIT THEM TO S£0. . - ^ AUDIT REPORT^ 
4 - 

ii. Institutions request £A applications* co?«»lete . varies by state; may ' . 

THEM* AND SUBMIT THEM TO SEO. ^ BE A-^ELEPHONE CALL 

5. SEO APPROVES EA APPLICATIONS. 

6. EA IS conducted and audit report IS ^JLED WITH THE SEO, EA Rerort 

t 7. SE) PILES A QUARTERLY PROGRAM PERFORMANCE REPORT AND PERFORMANCE REPORT 

U FINANCIAL STATEMENT >*ITH DOE. FINANCIAL STATEMENT 

,1. SEO SUBMITS ITS State Pla% to DOE. Approval is a 

PREREQUISITE FOR THE TA/ECM PHASES, STATE 

t . . 

1. SEO APPtlES TO ffiJE FOR TA/EC« Agurt I STRATI VE FUNDS. , PERFORMANCE REPORT 

^ Application , 

2. iMSTITUTltWS'SUBMiT TA APPUltATIONS TO^THTsEOi TA APPLICATION 
APf ENDING EA REPORTS. 

3. SEO RANKS TA APPLICATIOJ^. »Jk 

a. WJE APPROVES RANKINB AND FUNDS TAS. ^ . <• 

5. tlHILE TAS ARE BEINS CONDUCTED* INSTITUTIONS ADVISE SENlANNyAL 

SEO OF PROGRESS. • STATUS REPORTS 

C-.... i. 

5. «HEN TA IS CO*B»LETE< INSTITUTIONS F-ILE FINAl! TA ^ t» » - 

REPORTS. WITH SEO. ' ' F«NAL TA REPORT 

1. Institutions apply to SEO for EC«s, EC« application 

2. SEO RANKS TKE ECn proposals. 

i ^ 

^ J. DOE APPROVES RANKING AND PUUDS ECMS. ^ 

Dicing EC^I implementation/ institutions advise SEO Semiannual 

OP PROGRESS. Status Report , * 

5. When EPte are cmplete^ institutions final reports oc«^«^ 
WITH SEOs ? C Final ECfl Report 

6. iNSTtfuT IONS- FILE ANNUAL REPORTS ON EC« WITH SEO FOR 

^ 3 YEARS F0LLWIN6 CWPLETION. ANNUAL REPORTS 

/ 7. SEO sufiHiTS SEMIANNUAL Reports to m.jwm date DB»«.-r« 

f.» OF State Plan approval to end pF the ptosram. , State Status reports 
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Other X ire uBstances leading to program variability were: 

• Size and Financial Capacity of the State Sovernroent "- 
Smaller,' less pdpulous States FmI fewer funds for 
publicizing, traintng, information programs^ responding, 
etc. They also could spare fewer personnel to attend to the 
progjram. * 

• -Climate— Energy needs and equipment vary across the country. 

• "Quality tontrol" Procedures — Sobc^^ States built more of 
y these into their programs (e.g., in their specifications for 
\ EA forms, the type of TA review performed, 6tc.). 

• Interest in Renewable Resources --Some States were more 
-enthusiastic atout solar and renewabl^e resources than 

others . 

• Ranking Hetbods— Ranking procedures and formulae vjwried. 

« • Labor and Equipment Committfed — Effprts toward data 
collection vere different in diffflfrent States, as were 
monitoring and evaluation activities. 

• Affiliation of- SEOs- The SEOs were associated with /different 
governmental e^encies* (e.g. , governor's office. Department 
of Hesoirces, Office of Emergency 'Planning, Department of 

. Energy) . 

In addition, dVferent types of institutions varied in their needs 
and approach to participation in the ICP: 

• BUdget Cycles — Program scheduling was a major barrier to 
parrlcipaticn for some institutions, which needed lead time 
to raise matching funds. 

• Financial Capacity— Many' institutions had to divert funds to 
i ^the ICP from bthw* uses. Sont used funds from other vital 

areas, others dropped out. 

• Administrative Capacity— I nstitutional administrative re- 
sources were scarce for allying, reporting, managing 
capital im(>rovements, etc. 

• * 

• Bui Iding/Faci 1 ity Uses— Hospital s , schools, etc. operate 
d 1 f f ereSt 1 y , occ upy "cl i f f erent types of spaces, and have 
different occupancy ii^tterns. 

• Regulatory and Political Pressures— Each type of institution 
included -In this program is r^uiated in a different manner 
in relation to allowable expenditures, ^building and life 
safety codes, etc. 
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' Xf\ spite of these Program variations and the^ usual start-up and execution 
' problans of any Federal effort of this magnitude, the ICP has been Very well 
received afid is generally «:!cnowledged to be a successful energy conservation 
effort. 
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HISTORY sxf jm mkmim effort 

In the- fall of 1979. The Synectics Group. Inc. (TSG) was requeued by^ ICP 
staff at DOE headquarters to prepare a Preliminary ICP Evaluation Plan. The 
central focus of this preliminary plan was the process by v/hich overall 
Progran objectives could cllearly defined, and appropriate corresponding 
performance measures characterized." This definition of objectives, 
performance measures, and related data sources was to be accomplished through 
Informal interviews with ICP managers, energy conservation specialists, and 
offic;lals familiar with either the early development of the ICP or the 
administrative and financial requirements of eligible institution types i^'^^Jtj^ 
nonprofit schools, hospitals, local governments-, and public care facil Itie^^JjMt 
The preliminary plan assumed the ICP evaluation would focus on alV four^^ 
Progran phases (PEA, EA, TA. ami ECM), simultaneously. 

During the fall aid winter of 1980-1981. TSG evaluators conducted a number of 
interviews with relevant specialists and officials concerned with the ICP. 
this a:t1v1ty included attendance at the All States Conference held in 
rttshville. Tennessee (Novanber 1980) and a mefeting of DOE regional officia-ls 
held later that year; During these meetings attending officials were briefed 
on the scope of the Preliminary ICP Evaluation Plan and informal discussions' 
related to Program goals, information sources and major evaluation issues v«re 
held. • 

At the All States Conference, a short survey was conducted of State Energy 
Office (SEO) officials -attending tte evaluation workshop. Program objectives 
that had been defined during previous interviews with officials in Washington, 
D.C. were "tested," and lists of major problems ^nd benefits associated with 
implementation of the ICP were generated. These comments vere used in 
refining the material that had been included in the Preliminary ICP Evaluation 
Plan and In developing draft survey questionnaire. outlines. 

TSS and DOE staff then ' conducted preliminary interviews at four State and 
Regional offices and visited several inUitutional pafticipants chosen by 
Stat^ officials. Th^ preliminary field visits al\owed evaluators to see the 
ICP In action at a local level and to verify the general evaluation 
methodology that had been selected. . - '\ 

Restrictions in Program funding and concurrent reductions in available funds 
for evaluatlOT activities caused DOE to revise its original intention to 
evaluate the four program phases separately. As a result, in October 1981, 
Opportunity Systons Inc. (OSI). assisted })y TSG. was employed to redesign and 
■IfliplanKit the evaluation of the first two grant cycles. A general chronology 
of evaluation activities is provided In Table A.4. *j 
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ACTIVITIES AM) PARTICIPANTS 



DATE 



EVALUATI(»< STARTUP 
I 

STAIE AND REGIONAL ADMINISTRATIVE PR(X:ESS 
INTERVIEWS COMPLETED (0SI/TS6/00E) ^ 

PRETEST OF SURVEY INSTRUMENTS AND TELEPHONE 
SURVEY -PLAN COMPLETED (OSI) 



JCTOBER 1981 



' MARCH 1982 



MARCH 1982 



DATA COLLECTION ACTIVITIES AT SEOs CWPLETED 
(OSI/TSG) r ' 

s 

FINAL QMB APPROVAL OF SURVEY INSTRUMENTS AND 
5/WPLING PUN 

PRETEST -OF SITE VISIT SURVEY PLAN IN MISSOURI (TSS) 

9 

ICP INTERIM REPORT SUBMITTED TO DOE 



APRIL 1982' 

APRIL 1^82 
MAY 1982 
OCTOBER 1982 



TELEPHONE INTERVIEWS COMPLETED (OSI) 



NOVEMBER 1982 



SITE VISITS COMPLETED (T56) 



TELEPHONE SURVEY ANALYSIS SUBMITTED TO DOE (OSI) 



DECEMBER 1982 
MARCH 1983 



FOLLOW-UP SITE INVESTIGATIONS CONDUCTED (T5G) 



MARCH 1983 



FINAL SITE VISIT SIKVEY REPORT SUBMITTED TO DOE (TSS) 



APRIL 1983 
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APPENDIX B: SITE VISIT EVALUATION METHODOLOGY 



OVERVIEW * * * 

This chapter presents the,, details of each activity in the site visit 

evaluation plan. The following basic topics discussed: 

'' 'I 

• Survey Design ^ *• - , 

• Questionnaires . . » 

• Initial Data Gathering 

• Computerization and Storage of Site Visit 6ata 

• Data Gathering at Institution^ ' 

• Analytical Approach to Site Vi?ft D&ta - 

• Practical Problems and Plans for Resolution, 

Y . 

SWIVEY DESIGN* 

The survey design for the TA/ECM phas'e of the ICP evaluation is an extension 
and modification of that designed for the EA*phase, and is canprthensible only 
a« an intea^al part of the entire ICP evaluation. It is presented here in 
that contoTt. 

Target Population^ i» 

The target^ population of the evaluation varies with the objectives of its 
different phases. For the evaluation of the adninistratlon of the ICP-, the 
target population is the set of State and Territory energy office 
adninistrators. For the EA audit evaluation, the tafget population is 
comprised of four types of institutions {schools, hbspitals, local government 
buildings, and public care buildings) participating in the energy audit 
program. For tiie ^M evaluation, the target population is comprised - of 
schools and hospitals that participated in tills phase of the progran during 
Cycles .1 and II. i ^ 



. . f 

The statistical ^proach was designed by Joseph Steinberg of Survey Design, 
Inc., consultant to Opportunity Systems, Inc. 
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The frame for the evaluation of overall Program administration and 
implanentation. and for the first stage of sanpling for the other evaluation 
activities is comprised of States {49. excluding Nevada), the District of 
ColiJitf)ia. and Territories (4. Puerto Rico, Guam, the Virgin Islands, and 
Anerican^Samoa) . 

The frame for the EA evaluation consisted of the actual EA forms on file at 
the State Energy Offices. By DOE count.' there were 70.512 units in the fraje 
(57.311 schools. 4.023 hospitals. 6.648 local apvernment buildings, 2.488 
public care buildings, ahd 49 energy audits that were not classified) as of 
September 30, 1981. The frame for the ECM evaluation consisted o/ completed 
ECM grants. As of Septanber 30. 1981, there were 8,112 funded;' 1,012 were 
estimated to have been completed.^ » 

Sample Design 

In this section, the design considerations corresponding to each evaluation 
objective are discussed separately, 

Evaluation of Admin istrattpn ^ 

AH States and Territories are included to serve this (*jective. ^However, in 
order to secure the maximun benefit far the available budget. Personal 
interviews were planned 1p only 10 (instead of 54) sample States included in 
the sample for the EA and €CM evaluation, and telephone interviews *or the 
balance. 



. EA Evaluation • 

The objective of separate estimates for Ach ♦of the four institution types 
(i.e.. schools, hospitals, local government, and pubTic care institutions) was 
a major eianent in the sample design decision process, ^„^tc1I 
EA forms for second stage sampling Is available only «1 S'^^^^yr^^^Lc^h « 
and requires considerable maiual processing in some States (or is accessioie 
through computers In \)thers) , -each State or Territory needed to a pr1ma-y 
sampling aiit (PSU). if ai optimun probability sample design was to be used . 
Important factbrs affecting the sample design decision prpcess include the 
cost associated with: each stage of sampl ing, •securing the sample frame and 
the sanple of fonns. telephone Interviewing f or ^ certain types of data or site 
visits for other Itypes' pf data* processing and tabulating estimates and 
estimates of samplibg varl^llity. ^ 

Preliminary analysis of the joint requirem^ts specified precision for 
each of the fbur types of Institutions wlth.lri-^ha^vatlable budget resulted TrTv 
an mderstanding that a conroon sample of fSl^would be used for the J 
achievanent of the required objectives. Further, the same sample of PSlfe was / 
also to compr'ise the first stage sample for the ECM evaluation. 

: . , J 

er|c ' • ■ ' 



Sawpling Units 

The universe of first stage sampling i*nts is comprised of the 54 States and 
Territories involved in the EA program. The universe of second stage sampling 
units is comprised of the institutions, by type, that participated in the EA 
program for the first two funding cycles of the ICP iir each of • the PSUs. As 
discussed further below, the sample for first stage rnits was established as 
10 PSUs. Within each of these, the four, specified * i^tftitution itypes were 
^sampled to ^ovide a jrobability sample for the establishment df baseline 
information, as well as for the telephone interview and site visit phases of 
the Evaluation. 



Stratification 



Preliminary analysis determined that a sample of 10 PSUs would compromise the 
first stage sample units. Further, the n^ed to satisfy precision goals that 
were to permit useful analysis required that the character of*the distribution' 
of second stage units by first stalfte units be tiiken into account. Examination 
of the records of these distributions, both by institution type and' ECM 
funding status, showed that a relatively small nunber of States accqunted for 
a substantial proportion of each of the five subpopulations. However, since 
there were five target groups and only 10 sample PSUS possible, the State in 
each qf the target groups was designated as a certainty PSU. Five States were 
designated as certainty PSUs: New York, Illinois, Minnesota, Oklahana,. and 
Virginia. The balance of the PSUs (49) were then grouped into strata, taking 
into account the DOE Region, the likely average heating and cooling 
requirement characteristics of Regions and the aggregate me^sure^of size of 
each PSU (simned over the four institution types). Each Ttratun had 
approximately the same aggregate measure of size, within the constraint that 
PSUs should be formed by grouping the 10 DOE Regions. \ 

The five strata which comprised the PSUs {except for the f1v« certainty ^Ite) 
in the regions are as follows: r\ 



Stratum 
6 
7 
8 



DOE Regions 
I, II. Ill 
IV 

'V, vri 



10 



VI 

VIII. IX, X 



As is discussed more fully btflow, the selection of sample PSUs in each of, 
these non- self-representing strata was with probability proportionate to 
aggregate measures of size (PPS); with independent selection in each stratum. 
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Sample Size 



The prop9sed sample sizes for the four types of Institutions, to be used in the 
telephone interview ph^se were determined so that the estimated coefficient of 
variation would be approximately 0.9 for « proportion type characteristic 
where the propprtioa is 0.5. The estimated sample sizes were established as 
575 for schools, 500 for hospitals., 500 for local government cases, tnd 425 
for public care case§. For the site visits, proportional sample sizes were 
designed. the likely variance design effects of the stratification and 
selection stages were taken into account in estimating sample sizes, as well 
as the effects of the finite multipliers for the 4psti tut ion types vt\ere 
sample size was a material fraction of the universe. 



A>1ocation ^ Sanpte-Size ' 

The overall sample for Mch phase for each type of institution was allocated 
to strata (and sanple Ptiis) proportionately to the overall i^asure of size. 
The effects of a ratio estimate fktbr were reflected back into the 
allocation. 

In general, an overall sampling rate was established for each type of 
institution artl for each f)hase: the sample size divided by the population^ 
size. In the PPS sampling, a probability of selection for the set of PSUs in 
the sample was established: for the certainty PSUs. the probability is one; 
for the other five PSUs in the sample, the probability is the PSU measure of 
size divided by the stratun measure of size. The within sampling rate.iih 
general, was estabished so that ^e product of the within sampling rates %nd 
the PSU probability of selection was the overall sampl ir^ rate. Where the PSU 
probability of selection was* less than the overall sampling rate, cases>n the 
institution type in the smpU PSU are included (with a separate weighty ; then 
the difference in the sample take was reallocated to the other PSUs in 
proportion to the overall measures of the strata. The estimates of units for 
an iastitution type were ijsed as the denominator for estimating a ratio 
estimate factor, with the known universe total being the niinerator. The 
effects of the ratio estimate factors were reflected back into the sampling 
rates to reduce the variability of th.> weightif^. 



Sample Selection Process 

The first stage RSUs were selected with probability proportionate to the 
overall measure Of siz^e (the aggregate number of ener^ audits in the PSU) . 
wTthin the sample PSUs, the EA cases were classified by institution type and a 
systanatic sanple was selected. A random start was used in drawing the sample 
and the within sampling rates were used as the sampling intervals. 



E« Evaluation: Site Visit Sample ' ^ 

The sample defign for this activity parallels that for the EA audit 
evaluation. The first stage PSUs used for this activity were identical with 
jthose selected for the EA evaluation described In the previous section. 
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The universe counts of canpleted cases in ttie ECM progran for the 10 s'anple 
sites was approximately 400./ Of these, 150 were selected for' site visits 
using exactly the same approaches as for the EA evaluation {use of within PSU 
sampling rates to achieve the goal of having the product of these rates and 
the PSU selection probability a constant, where feasible). Institutions that 
were large in size (250,000 sq. ft. or more) or had* a large grant anount 
{$200,000 or more) were incl uded -with certainty. 



In 
to 



each of the 10 sample States, the remaining cases were stratified according 
the following institutional characteristics: » 

Level 



factor 
Size 

Grant Anount 
Institution Type 

ECM Type{s) 



1. 
2. 

•1. 
2. 

1. 
2. 

3. 

1. 
2. 
3. 
4. 

5. 

6. 

7. 

8. 

9. 
10. 
11. 
12. 
13. 
14. 
15. 



Less or equal to 37,500 sq 
Gre'ater than 37.500 sq. ft 



ft 



Less than or equal to $50,000 
Greater than ^50,000 

Elementary or secondary school 

Lhiversity 

Hospital 

Building envelope {E) 
Mechanical {M) 
Lighting (L) 
Special (S) 



E 
E 
E 
M 
M 
L 
E 
E 
E 
M 
•E 



M 

L 
S 
L 
S 
S 
M 
M 
L 
L 
M 



L 
S 
S 
S 

L 



+ S 



J 



The methqfl of probability selection used was an approximation to controlled 
selection dn the basis of these factors/ lev els. . This ensured that sample 
selection was proportionate to the distribution for each characteristic by 
factors/levels . ' 



1 



See M. H. Hansen, W. N.* Hurwitz.'and 
and Theory , Vol. 1:, pp. 476-80. New 



W. G. Mactow {1953)' Sample Survey Methods ^ 
York: Wiley. 
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Estimation Procedures ti^ 

The estimatiofi procedures followed made use of information on the prob^ility 
of selection of each sample unit, the number and characteristics of 
non-response units, and tne merger of original sample ^J^s. The estimates or 
SWlinT variability will be based on -standard estimators Applicable to the 
sampling and estimation procedures. 

I 

Base Weights , • 

■nie base weight for each sampling unit is the product of the reciprocal of its 
PSU's probability of selection and the reciprocal of its within PbU 
probability of selection. 

Non-Response Adjtistment Procedures . 

The characteristics of th'e,-^ responding .units and non- responding i^^^ts were 
detemined fron the TA reports and ECM applications, ^ton-response adjustments 
were calculated within cells based on unit characteristics. The adjustments 
used the base-weighted data fcr the responding and non- responding units, the 
factor^in each group being the ratio for all ifiits to that for responding 
units. ^ 

Merger of Sampling Uhit 

During the data collection and analysis lyrocess. the previously defined 
sampling unit occasionally was expanded. This typically occurred when the 
fuel data associated with the original sampling uiit was found to be 
inextricably combined with other members of the sampling ^'^aj^ ^s» for 
example, when. the fuel consumption data for one building in a complex was onlv 
avaiUle indirectly as part of the entire complex's energy -Records. Fo*^ such 
cases two weights were calculated: the weight representing tte Probability of 
its selection after adjustment for non-response factors, and a second weight 
reflecting the increased likelihood of this expanded unit being selected 
within its -PSU. The latter weight Is used fw- estimates of fagnitude 
variables (e.g., changes in fuel consunption) ; the ^fna^.^s applied WJen 
estimates of population (e.g.. number of ECMs affecting lighting systans) 
units are desired. 

t 

Estimates t 

Survey estimates are based on res^^ts for responding units »«here each unH ^as 
a defined weight: the weight in each case is a product of the base weight and 
the noo-response adj^jstme^t f^ctdr. The wBig>W:ed t^sponding ^^ts are the 
entities lhat are usal for deriving estimates of aggregates, cross-classified 
by analytic variables, aggregates, etc. 
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Estiiiation of Precision 

For the' weighted sample , of ECM grant-ees, estimates of precision were 
calculated for three estimates of aggregates--base year total energy 
consisnption » latest year energy consumpt;ion , and' the difference between base 
and latest year total energy consumption-- and for the ratio of the difference 
in total energy consunption to base year total consumption (i.e., percent 
energy saved). The 90% confidence limits for these four estimates are: 



Estimated Variable 



90X Confidehce Internal* 



Lower Limit Estimate 



Upper Limited 



(1) Base Year Total 
Energy Conswnption 



Year wtal 



(2) Latest 

Energy Consunption 



14.914,452 



11,597 »000 



39, 143; 492 



^33. 973, 839 



63.372,532 



56,350.678 



(3). 



Difference Between 
Base Year and 
Latest Yeai 




^ (4) Percent Energy Saved 



;850,585 



9.30% 



5,169,653 



13.21% 



7,488,721 



17.11% 



As shown above, the 90% confidence intervals foi>- the three aggregate energy 
figOres are fairly wide, reflecti/ig in part the relatively small sample size. 
Hov^ver, the 90% confidence interval for percent energy saved is much 
narrower, indicating that the sample was sufficient to pemit a precise 
estimate of the relative energy savings attributable to the.ICP. 



*In minions of BTUs 
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QUESTIONNIMRES 



Two. basic survey Instrunents were designed and fresented by DOE for (»jB 
approval : . 



t Energy Audft dutpuf^urvey (EAOS) for use in obtaining 
follow-up data from EA institutions 

• . ECM .Survey (ECMS) for use in obtaining qpdated cost and 
energy use information from EQM institutions. 



Both EAOS and ECMS were designed to b^ used either in a telephone interview or 
a site visit'.- The^ite visit questionnaires, however, contain an additional 
canponent: a ' walk-through verification of reported energy conservation 
pract1ces,-»and an assessment by the site-visit team concerning the 
approjrlateness aid the quality of ECM installation and maintenance. ^Pretest 
results danonstrated that, with minor modifications, the EAOS could be used 
successful ly to gather the requisite data by telephone; it vas also used in 
the field. The ECMS was developed to collect data concerning the impact of 
ECM installation on the energy usage of grantee , institutions and their 
experience with DOE grant adninistr^tjon^ and was used ultimately as a site- 
visit instrument on,ly. ' ^ 

At the conclusion of the EAOS pretest, the instrunents and a supporting 

statanent were resubtiitted to DOE.»- After EIA review, the . package was 

submitted for OMB approval, ' Notification of thil approval ws received on 
April i, 1982. 



INITIAL DATA fiATHERINfi * ^ 

Initial data gathering Involved (1) Interview^g DOE Regional ^fices and 
State energy offices (SEOs) far adninistrative infonnation and a sense of^ 
Program perforSfmce and (2) simultaneous microfilming of thcdbciwentation -for 
all ICP phases ifi which selected institutions had participated. These two 
operations are discussed in sections, that follow. » 



State and Reqlwia.! Intervleig 
Objet^ives and Procedures 

Before the survey instrunents were made final , manbers of the ei^aluation teams 
and officials from DOE Headquarters conducted cwnblned interviews and 
briefings of ftegional offices and SEOs 4nvolved in the administration of the 
Program In the 10 sampled States. 

The purpose of the State attoninistrative process interview (API) was not only 
to gather 'specific historical infonnation on the infplementation of the ICP, 
imt alSl» to get feedback from SEO personnel on the maj«r successes and 
problems associated with the Program. 

- 
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The interview sessions served several objectives: 

'• To brief State and Regional officials on the content and 
schedule of the ICP evaluation activities. 

• To solicit adninistrative support for the ICP evaluation 
from various parties. ^- 

t k 
9 To provide DQE Headquarters with an administrative history 
of the first, two grant cycles of the ICP. 

t In th§ case of' Regional -fnteryiews, to discuss 

administrative or technical approaches and 'program 

experiences in each of the 10 sampled States in comparison 
to other States within each Region. 

t To verify that the basic evaluation desig^TvSis i;racticable 
in each State. 

t To understand the viewpoints, needs, and administrative 

concerns of Program officials at the local level. i 

9 To ascertain local variations in f¥(^ram administration 
that could affect the results of telephoqe and field visit 
. surveys' of institutions participating in the EA and ECM 
phases of the ICP. ' ' 

* 

• To provide a basis for later correlation between State 
defisidns and actions, and the character and effectiveness 
of work performed at the institutional level. 

• To evaluate the comparative effectiveness of different 
administrative and technical approaches taken in SEOs to 
training energy auditors and TA analysts. 

• . To evaiiate the impact of different ranking fomulas and 

regulations used by S^Os. ^ ^ • . 

The following procedures were followed for contacting State an^ Regional 
interviewees and initiating data collection activities. 

• POE Letter to State and Regional Offices —This initial 
letter sent by D(£ Headquarters to the. ten State and eight 
Regional offices served, a^ an introduction to the ICP 
evaluatiwi. Included in the letter was a brief statement on 
the selection process of States, and procedures and 
preliminary schedules for data collection activities. 

• OSI Letter to State Offices- ^A letter was sent to each of 
the ten state Offices introducing the .QSI/(I5G evaluation 
team and outlining details for interviews and da^a 
collection. 
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QSI/TS6 Telephone Contact to SEOs— Each SEO wai contacted to 
arrange ai Interview date. Wso during this telephone 
contact, the evaluation team collected preliminary 
Information on the status of State files in preparation for 
data collection activities- r Infonnatlon deluded: total 
niJirt>er of EA. TA, and competed files; filing systew' and 
accessibility of files; and' degree and type of automated 
data files, if appropriate. 

state and Regional Interviews — The State and Regional 
Interview teams arranged travel geographically, and arrar^ 
to meet wfth tegional support personnel prior to visiting 
State Offices. The average tt^ spent with actalnlstrative 
pertonn44 was 3 to^ 4 hours . 

Diit a Collection— The OSI/TSG data collectipn team arranged 
its schedule concurrent with the State and Regional 
interview teams, when possible. However, data collection 
efforts required an average of 3 to 5 days on-site to pull 
the sample from the f^les, microfilm docunef>ts, and restore 
the office's original filing system. 



Type of Information Solicited 



information 1«re incl uded In the State API : 
1. Resources and Organization 



Three majqr categories , of 



• SEO Staffing (nunber of personnel assigned to ICP, 
special training Involved, contractors us^) 

• Administrative Costs (total ICP-related costs, deployment 
of Federal^ funds, source and type of matching funds, 
publicizing the Program) 

• Impacts of Other State Energy Conservation Programs 



r 



2, ManageiTOnt Policies and Procedures 

• EA Phase (all aspects of auditor training) 

^ t TA Phase (training and/ or quail ficat lews o? analysts, 
guidance for 1^v,^anking criteria used on TA 
appl Ications) 

• Docu mentation (report design, treatment of grant 
appl Ications, dociAientation of participation, quality 
control) 
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t Hon 1 tori no Activities (types, find ings , ^ fol low-up 
activities) 

• Inylewentation of ICP (problems and solutions) 

€ 

3. General ICP Experience 

• Successes and /failures concerning institutional 
participation, and penetration rates of ICP activities 

• Any financial, political, or administrative barriers to 
participation experienced by eligible institutions 



Hlcrofll^ng 




Baseline information Mas collected from the records of SEQs in the Initial 
stage of the. data collection process. An OSI/TSS data collection team 
fflicroffilmed a stratified -randcwi sample of EA forms and accompanying 
Information (e.g., correspondence), using a . random starting point and a 
defined sampling infterval within each institution type.* The EA and TA 
reports and the ECl¥ grant appl ication were microf limed for each completed ECK 
case. Where they Memvayailable, the'PEA reports also were copied. 

ft 

DATA Fathering at ij^titutioms ^ 

The sections that follow briefly describe the procedures used to collect EAOS 
and ECMS data during site visits, and the activities undertaken In preparation 
for site visits. The procedures used to ^collect telej^one survey data are 
found in OSI's report. Institutional Conseryation^rogram: Analysis of the 
Impact of the Energy Audit~on Selected Institutions . I 



Conducting Site Visits . ^ 
Objectives 

Data from visits to 136 evaluation sites"24 EA only and 112 completed ECMs- 
-are included in the evaluation. The objectives of the site-visit component 
of -the evaluation effort were: 



♦This systanatic sampling revealed some inaccuracies in the estimates of 
total ICP population av'allable for inclusion in the evaluation. , In one SEO, 
sampling intervals had to halved In order to gather a suitable number of 
records^. 

**Reduced from an original 188 due to various problems: see Chapter 2. 
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To verify .(l) fuel savings and (2) continuance of 8&M 
procedures ; 

To gathe r infonnatlon on (1) costs and savings associated 
M specific types of ECMs and »Pecif1c types of 
institutions, (2) technical successes and difficulties 
associated with specific ECMs. and (3) actelnistrative f 
processes related to Program tnplementation; 

To determine (1) the extent to which institutions were 
, Involved in energy conservation prior to the ICP. (Z) ^at ^ 
i additional energy conserving «:t1vi ties could be do«», and 
^ (3) secondary Impacts of program participation on individual 
institutions and local cannunitles. 

Site Visit Organization 

The order of States visited was arbitrary aid tes qd ^nPff * °" JJ"*^ SJJ^" 
findings. Site visits were scheduled geographicajy within each State, 
g^rally allowing ijne *1f day per institution Including t^*vel time. Actual 
time spait at institution was approximately 2 hours. TT>e f ©l owing 
procedures were used for contacting Institutions^jWl setting site visits. 

• SEO Con tact CaTl --SEOs wfer-^ Informed by phone of the 
institutions to be visited and the tentative site visit 
schedule. The SEO's level of participation in planning and 
executing site visits (e.g., introductory contact to 
institutions, schedul ing ' site visits . or accompanying the 
evaluatldn team to institutions) was determined. 

• Follow-up Letter-A letter was/sent to ths SEO requesting 
verification ot institutional daU such as ^"ta^t person, 
grant awanl anount. total project' cost, and Ins^J^w f^; 
Copies of correspomJence also were fbr^rded to DOE ReglpnaW 
support offices. 

• Institutio nal Contact Call- Jhis first communication with an 
Inititution's ICP contact described the overall evaluation 
Dian as well as the types of information sought dwing the 
sitkvisit. The visit was scheduled ana arrangements were 
made^?' other Involved parties (e.g., the Tk analyst , the 
buildlWg engineer, and/or maintenance personnel) to be 
present during the site visit. S 

• m FnllowuD letter. Institution^ -This lettep*— fonf1i«id t^ 
arrangem^ts made lor the sit e visit, outlined the specific 
types of questions to be asked during the interview, and 
enclosed fuel consumption data charts that mrB to be ' 
completed prior to the site visit. 
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In the early'^ site visits, respondents were asked by 
telephone and letter contact to provide post-EA energy 
consunptlon data for delivery at the time of the visit. 
This procedure was si^sequaitly revised to request that dmta 
be mailed prior to the visit. By pre-vlslt analysis of such 
data along with the £A and TA sources of energy d9ta It ' 
becane possible to Identify any need for special probing 
xluring the^lslt. In particular. Institutions that 
disclosed -«fther particularly high or low consumption 
changes were flagged for more In-depth questioning to 
•confirm this apparent result and to discover its cause. In 

^ many cases this allowed errors In data to be resolved and/ or 
provided an opportunity for the respondent to become 
^ involved m seeing, scmetlmes for the first time,. what the 

— ^rend had been during the recent past. • 

• Pre-Travel SEP Contact - -SEOs were called after all site 
visits in tne state had been confirmed to -coordinate travel 
arrangements In those States that wished to have. SEO 
personnel accompany the evaluation team. All SEOs were, sent 
copies of site visit schedules regardless of their 
participation, as *«11 as copl-es of the survey instrunaits 
that were adninisterled. This enabled the SEO to answer any 
questions posed by s^pled Institutions. 



On-site Procedure \ 

* 

Site visits were conducted by a, two-person TS6 evaluation team composed of an 
engineer to analyze the technltal energy conservation applications in an 
Institution, and a program specialist to review the c^alltatlve Ad 
adnlnlstrative process details of program participation. In sane States?^ the 
team was accompanied by a representative from the SEO. Ch a ftew visits a DOS* 
representative was »lso In attendance. 

The institutions that had participated only in the £A (^ase of ICP were 
adnlnistered EAOS; the Institutions that had completed ECMS were administered 
both EAOS and EO^S. Itegardless of the instrunents used, every site visit had 
two canponSils, an Interview and a building walkthrough. Each generated a 
different kind of Inftjnnation: ' 

• Administrative I ntervlew — Administrative processes and grant 
fO/ procedures, energy conservation activities and attitudes of 

^Jjr building occi^ants, verification of fuel consunptlon data, 
yL schedules and cost modifications of grants, secondary 

Impacts of ICP participation (e^g. wergy conservation 
\ ^ spinoffs withfn or outside the institution), and general 

attitudes about each pnase of ICP participation 

• Bulldlno Walkthrough — Verification of O&Ms and ECMs , 
proD 1 em^^countered w1 th Installation and operation of O&Ms ^ 

\ and ECNs, Interface of O&Ms and ECm with other building 
^ systems, potential for additional O&M and/or ECM efforts. 
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TJ* interview orocess aenerally required about one hour of quest io Answer and 

dlsc^ ?on plu^To^^^^^^^ hour o^f facility JjIktW li'%p^J''fTt \h\'TaHed 
The sequence of these activities was tcept flexible to best fit the varied 
c ire Instances encoimtered. In most Instances the respondent vfis first met in 
Sis5!f^ office ari the walkthrough was conducted last, respondents had 

invited additional staff manbei^s and/or the a«iitor ;r teclwical analyst to be 
present. Although a larger nui*«r of pa-sons in /"endance usuai^^^^^^ 
extend the interview, the quality and quantity of available information also 
deemed to improve. 

Use of the formal questionnaire was not allowed to structure ttei^^^^^ 

such a way as to limit tte range of topics and constructive carments that the 

respondent wished to address. ^ using the questionnaire to assure discussion 

of at least the formal questions, the group was avowed to ^^^^^^f^lJ.^?*'*! 

matters as it wished and thus voluntarily contribute to the depth and value of 

the Interview. This was vital in certain cases. For example, the random 

selection process for choosing site visits sometimes selected only one 

bu IdinS out of a qroi^ dr complex of buildings which the responc^t had deaU 

with collectively. In such cases the respondent «is not alv«^^^ 

to Isolate his comnents to that particular bui Id i»^. but , rather 

Sle to discuss the overall program and process ^o",,*^!* 

She^ the interview team's pre-visit study had established t>« stj larit es 

(and differences) of the selected building with the complex of buildings, the 

respondent was fiee to convey more useful In format ion thim had he been forced 

to limit discussion to only the specifics of the selected building.. 

Site Visits: Preparatory Activities 
Focus 0^ Pjreparatlon 

^e evanLtlon team deemed it highly desirable to Mve obtained maxima 
inslgtt I^Tto the facility anJ its history before exouting t»« s te visit. In 
preparation for each visit, tean members reviewed the Institution s ICP 
docunents for the following information: 

• The pre-ICP conservation Improvements laidertaken with other 
funding 

• \e, baseline energy consumption of the facility and the 
tVr^of fuels Involved ^ 

t^Some approximate Indication of conservation potential 
derived from an awareness of the age of t^ sjpructares . 
types of materials, general configuration, orientation, and 
type and hourly schedule of facility use. Additional 
information on existing mechanical equipment* and contJMl * 
systaiK provided the"^balance of a minlmun store of knowledge 
about the facility to be visited. 

* • The O&M procedures reconmended for incorporation at the time 
of the EA 
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t The*lCMs recommended for tnplementatlon, as well as their 
projected costs ^ simple payback estimates 

• The general qua! ity of the TA and the EA in-order to 
determine whether thorough, accurate, and complete 
analysis was available to the institution. 

The TA Reviai^ 

This pre-visit analysis cons tit at ed a^A ftevicH.'' stnce a TA: report was 
always associated with a completed ECM institution and was always examined. 
However, the pre- vis it review feen entailed much more:_ a look at the 
institution's EA report, correspondence, -^nd ECM grant application, for 
example. (Of course, EA-only institutions had limited docuuentation, and pre-v 
visit analysis was less complex- for them.) ^ 

The TA Review enabled the site-visit team to conduct a more productive 

Interview. The limited time available at the site (and the desire to keep the- 

r^spondeRt burden to a minimum) dictated that as many questions as possible be 

resolved by study prior to tre|ifel. Furthernic(ff> it was flattering to th^ 

respondent that the evaluators were interested wough to have acquaintect 

themselves with his or her facility. Frequently, this produced more 

enthusiasm on the respondents' part and led to a freer exchange of useful 

information. 

* - 

Y 

The task of reviewing the microfilmed ICP docunentation varied considerably 
for several reasons. Generally the size of the task was proportional to the 
■■■LflmfLl RX ity and sq ua r e- f o ot a g e~o4 the facility, -l^ut it a1 so-ti^pended — 
significantly on the methods used by the particular technical analyst. There 
was a vride range of detail provided in the TA reports and the formats used 
were as nunerous as the analysts involved. Particular attention was given to 
noting thfe kinds of ECMs selected for study in the TAs and reviewing the 
engineering calculations that supported sucm analysis. In some cases, the 
calculations were nonexistent because a pacimged computer program had been 
used by the analyst. In such cases even the Inputs to the computer program 
were* frequently dir(icult to identify and only computer answers were shown. 
In cases where manual calculations were shoVi, it was often difficult to 
explore them due to the lack of explanation of the widerlying* assunptlons that 
led to the use of a particular path of reasoning. Obvious mathanatfcal errors 
were noted. Otherwise, questions were raised in an effort to achieve 
understanding. , < 

FolTow-Up Site Visits - ,^ ^ 

The purpose of foilow-u^ site visits was to determine the causes of apparent 
increases in energy consunptlon at selected institutions. Identification of 
sites- In this population w»re determined by thoroughly revile wing both 
computerized and field data to correct data errors. Data was th%) analyzed to 
determine if energy use Increases were due to factors such as changes In 
weather, building square fQptage, utilization, and/ or energy metering. 
Additional review by the evalutlon team'^ engineer was conduct«l to determine 
whether the technical characteristics of the building and Its energy , 
conservation activities warranted the original savings projections. A limited 
nunber of sites then were telected for in-depth technical on-site review. 
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Procedures for conducting the follow-up site visits paralleled ' the procedures 
described earlier for ECM si te visits . , 

J ■ ■ ■ • ■ - 

COMPUTERIZATION AND STOjAfiE OF SITE VXSIT DATA 
Site Visit Data •* " 



Three orincipal ' kinds of da> were brought back from the field: "checklist 
data, energy use data, arfa 0MB survey instruneift data. All data were 

automated . 
« 

Checklist Data 

Immediately following each s^ite visit, the TSG evaluators completed a 
V "checklist." which is a siinnai»y record of their findings and impressions at 
%ach institution. The information recorded 

was not^meant to be strictly objective and jpntitative. It was 
intended to record their expert judgment on the ^^ctorrthat^^ppeared to be 
contributing to the success orvfailure of the ICP's implementation at that 
site. By correlating these impr>vions with the actual, energy savings at the 
institutions, the evaluation st^l v«s able to gain ^"slght into these 
^critical, success factors so that DOE and the States can comnunicate them to 
all institutions'. ^ , ■ 

Energy Use Data ^ , 

.The site visit team sought energy use^a for at least P^e ^ear prec^^ng ICP 
implanentation (i.e., the EA date) and one year following the latest ICP phase 
(either EA date, TA date, or ECM opei^ational date) at each institution The 
raw data (gallons of fuel oil. cubic feet of natural gas. tons of coal, etc.) 
were recorded. The data are organized ipto two periods:^ , 

t Base Year , a period preceding the EA date 

• Latest Year , a period following ECM implementation. 

Where a full year of data after ECM impTemaitatiop was not available, the 
periods .were adjusted to provide for comparison of .nke periods. 

Other Survey Instrusent Oata 

* 

tAOS and ECMS collected not only e.iergy use information, but also the 
quantifiable responses to many other q|e5t1ons t^OJOut J^oO'-f .f^f^^^' 
EAOS and the ECMS responses, wefe incorporated into the site visit data base at 

'i ' { . ■ 
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ANAtYTICAr APPROACH TO SITE VISIT OATA ^ ' ^ 

The ultimate goal of the IC^^ evaluation' s analytical effort was* to determine 
the energy savings impact of the program and the factors which contributed to 
an institution's suc/:e5Sful performance. Qhce all data were collected for the 
EA and ECM sample, they were* adjusted by appropriate weighting factors so that 
the final analysis reflects a representative sample of all Cycle I and II ECM 
grantees whose projects were completed as so September 30» 1981. 

Data Base Processing 

The analysis consisted of the following principal procedures: 

f 

• >^w energy data were processed for each si te\ using VISICALC 
soft*«are; this produced BTU totals by energKtype for the / 
base yiear and latest year^ (see Figure B.l far a sanple 
VISICALC report) . ^ 

f Totals for the raw energy data, along/with building 
characteristics, administrative and -HTechn ical field 
observations, were coded for entry into the Statistical 
Analysis System (iAS) software. 

• SAS was used as the frfmary analytical tool. Three kinds of 
SAS progr^'were used for various parts of the analysis: 

- frequency distribution, ^i^ich displays the number and 
range of values for eac> variable 

- univariate analysis, which calculates sums, means, and 
other statistical features for each variable 

- correlation analysis. \^ich is ^ed to calculate mi test 
the signif icancefof relationships between two varflables 

/ using linear regression, 

• Then the SAS programs ^rs used to produce analyses of the 
following types: ■ , 

Ik ' 

- Energy and cost savings for the entire data base; 

- Correlation between' Epi cost, institution s1ze% energy 
savings, and cost savings; 



Energy ^d cdst savings coruparisons between varirous 
subgroups within the data base, including: 

. ECM recipients and EA participants / 
. schools and hospitals 



146 



. types of ECM& 

. groups based on questionnaire responses (e.g., 
respondents answering "yes" or "no" to individual 
questions) . . 

Th^se analyses were conditioned by the following factors: 



• Weighting fktors desigl^BB to amplify results to represent - 
the original sampling miverse of Cycle I and II grantees 
(see Appendix B for Survey Design), 

t ProbAility factors which determine the significance of 
correlations between two variables. • 

t Tes,ts used to assess the significance of comparisons between 
subgroups such as ECHs/EAs, schools/ hospitals, questionnaire 
respor»ses, etc. 

Data generated during the analysis fall^into the three following categonies: 
1. Basic Energy Data * , 

t Base Year Consumption data in million BTU, for: 

- electricity (source BTU conversion) 

- electricity (site BTU conversion) 

- natural Qas . 

- oil 

- coal 

- stefim 
total (source BTU |pnversion) 

onv< 



- total (site BTU conversion) 
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Latest year consumption data, as above. 

»- 

t Change in energy consunption (base year minus latest 
year) as above, non-weather- correc ted . 

• Weather- correc ted change in energy consunption, as above, 
t Percentage change in jenergy consunption, as above. 

• Weather-corrected percentage change in energy 
consunption, as above. 

2, Related Energy Data 

• Square footage 

• ECM total cost 

t Million BTU saved per square foot. 
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ECM cost per mm Ion BTU saved. » 

• ECH cost per square foot. 

These five variables, plus total change , in BTU consumption 
and total percent^e change in consunption, were tested for 
correlation with each otter. 

3. CateqOrical'^ata ^ 

There are three kinds of categorical variables: 

• Institution type (schools, and hospitals for the ECM 
sample) . / 

• ECM type (15 types) . 

• Field questionnaire respon.ses-- incudes 56 items from 0MB 
questionnaires and field checiclist 

For each of these categorical variables, ISG calculated: 

• T^e ntinber of institutions in each category. 



• Av^ge percent energy sayings ( weather- corrected , 
non-t&rrected. Source BTU, Site BTU). 

t Average square footage. ^ 

• Average project cost. 

• Ava-age project cost/squ^ foot. 

, • Average project co^/million BTU saved (weather- 
corrected', uncorrected. Source BTU, Site BTU). 




0 
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APPENDIX C 

♦ 

UNDERLYING FACTORS OF THE ANALYSES 

Several' assumptions, conversion practices, and data adjustments underlie the 
analyses conducted for the evaluation. Jhese are described in detail below. 



Calculation of Energy Savings » 

Each type of energy used in a facility was first converted to equivalent units 
using the British Thermal Unit (BTU) standard. The following formulae were 



for this purpose: 


/ 


Electricity: 


Kilowatt hows (kWi) x 11,600 BTU/kt«i = BTUs 


#2 Fuel Oil: 


Gallons x 138,690 BTU/gallon « BTUs 


#6 Fuel Oil: . 


• 

Gallons x 149, 6M BTU/gallon " BTUs 


LPS: 


Gallons X 95,475 BTU/gallon » BTUs 


Natural Gas: 


eubic feet (Cf^ x 1,030 BTU/ft^ « BTUs 


Coal : 


Tons X 24,500,000 BTU/'ton » BTUs 


Steam: 


Pounds X 1,390 BTU/pound » BTUs 



fn order to permit proper accounting '^n equivalent BTlte for energy consunptlon 
by facilities using remotely generated steam, or electricity as jcompared to 
conversion on site of meayired quaRtities of a raw fuel (e.g., fuel oil, 
natural gas, coal) the following assumptions were used: ^ ' 

• Conversion of electricity Is based ^on an average nunber of 
BTUs expended at the generating plant to produce and 
transmit a kilowatt hour of energy as metered at the user's 
facility. This metered kilowatt hour of electricity 
provides the user with 3,413 BTUs, but it requif-ed the 
expenditure of 11,600 BTUs at the generating plant. ^ 

t Conversion of mo/tered stea^ includes an assuned average 
efficiency for boiler conversion of raw fuel into the* steam 
product. Where a specific bo\]&r efficiency is knowi, a 
more accurate conversion of steam to equivalent BTUs may be 
achieved. 
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Energy savings were calculated for a given facility by subtracting the total 
annual BTUs consumed by that facilitj|y in the post-ECM period {latest year) 
from Its total consumption during the pre-EA period (,base year). 

Percentage energy saving results were determined by dividii^ thei above 
calculated BTU savings by the total BTU consimiption of the base year, and 
multiplying by 100: 

« c,„4«„ Latest year BTUs - Base Year BTUs ^ 
. ^ Base Vear S T Uis ^ 

Weather Correction • • ^ 

Becluse of the limited precision of iBiiversally applicable weather correction 
methods, it was decided to use original, nonrcorrected data as the basis for 
overall evaluation. Howev»*, weather correction is used in selected cases 
where weather. correct1(»i assisted in the case analysis or elaboration of 
specific points. In such cases, the correction was based simply on adjusting 
the latest year (post-ECM) consunption by the ratio of the total recorded 
degree-days of the base year (pre-energy audit) to that of the latest year 
(post-ECM). The simplicity of this ignwes m^y factors but generally 
provides a degree of correction to the results that is at least in the proper 
direction, if not always of the precise magnitude. ' 



Barrel of Oil Equivaljint 

Sometimes, ' total BTU savings are translated to Barrels of Oil Equivalent 
(BOE). This is done for illustrative purposes only. Actual energy . savings 
Included a mix of raw fue'ls. 

Since a major goal 0/ ICP was to reduce national oil dependence, comparison of 
energy savings to BOE is* useful to illustrate the hypothetical Impact on oil 
usage. Within the ICP the total heating oil reductions in 'BTUs exceeded the 
total of all BTU savings. This occurred because of the large number of fuel 
conversions from oil to gas which did not necessarily produce BTU savings, but 
did reduce oil use. The convers1c»i to BdE °1s based on the standard measure of 
42 gallons of oil per barrel, with a total content of 5.23 million BTUs per 
barrel (bsed on DOE/EA published figurfes for consuned heating oil in the 
1981-82 period). 
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EnergaTCost ^Inqs CalcuUtlons 

Energy cost "-sarrings were calculated on a non-discounted basis (i.e., energy 
savings in BTUs were valued at 1982 average national energy prices). These 
prices were then assumed to remain constant. Increases or decreases in energy 
prices, or discounting of future cost savings could change payback and related 
financial calculations: 

Cost Effectiveness of ICP at: ECU Institutions 

^1^^— V^V^B^^B^V^B^V^BVW^^^^— ^^4^-^^^^— ^^^^^^^^^^^^^^^^ 

Cost effectiveness of , the ICP at ECM institutions is defined as the total 
dollars spent for ECMS divided by, the «total savings in millions of BTUs 
occuring at those institutions. ' litis also includes savings at the ECM 
institutions which resulted from O&M actions recommended by the EA, as well as 
any additional energy saving actions. However, the available energy 
cons'unption data does not permit adequate segreg^tioi of these contributing 
factors, • * 

It is assumed that the federal 'dollar participation in the ECM institutions 
averaged '50 percent of the total dollars spent. Thus, the cost effectiveness 
of federal dollars is assumed- to *be twice that of the total project's cost 
effectiveness. ' 



ERIC 



^151 



» 



APPBOIXD 
aOSSARY 



Administrative Process Interview. This questionnaire wa^ 
a(ftii1n1stered to personnel at « State Energy Offices as a preltninary to 
field and. telephone Mork. 

U.S. Department 6f Energy ' . 

An Energy Audit perfonoed with ICP funds, and the second 
data-gathering phase. of the program. Audits conducted- under other 
programs are^ referred to as energy audits, not EAs. 

Energy Audit Output Survey. An OMB-approved questionnaire 
administered to institutions that participated in the EA phase. EAOS 
is being adhiinlstered to institutions over the telephone, and at all 
site visits. 

Energy Conservation Measure, a major capital ex^nditure underwritten 
by luP funds for the purpose of energy conservation. 

Energy Cons qjfci tion Measure Survey. An OMB-approved questionnaire 
adm1nistere<HI institutions that have completed the ECM phase of 
ICP. ED1S was actoinistered durii^ site visits. 

Heating, v&ttilating and air conditioning (describes an air handling 
system) . 

Institutional Conservation Program 

Operating and Maintenance Procedures undertaken for the purpsoe of 
energy conservation. ^ 

Opportunity Systems, Inc.j. the prime contractor for the ICP 
evaluation. I 

Preliminary Energy Audit, the first data-gathering 'phase' of the ICP. 

State Energy Office. AltNiugh the names may vary, each of these 
State offices is responsible for oversight of energy-related 
activities. 

Technical Analysis, an assessment performed by an engineer or other 
qualified professional with ICP funds for the purpose of recanmerKJin^ 
the best ECMs for a specific institution. 

The Synectics firoup. Inc., the subcontractor for the ICP evaluation. 
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